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A. 


ir LOC? LON 


Sine dollar Spent on training today is a marginal 
deanar. Today, more than ever, training professionals 
Mist demonstrate the effectiveness of their programs.... 
Spending money on unnecessary training, inappropriate 
meernine, or training that doesn't train can spell 
disaster for those who design such programs." [Ref. 1] 


BACKGROUND 


These introductory remarks were written by a learning 


technology manager in industry, but they apply equally well 


to the government sector in general and to the Coast Guard 


Mmmmoarcicular. Training plays a vital role in preparing 


Coast Guard personnel for the increasingly complex skills 
required to meet the challenges of technological growth. 
INR is required to insure that the Coast Guard can 


i 


take advantage of modern technology by using all of its 


resources as effectively and efficiently as possible. These 


Mede financial, physical and human resources. It has 


been said that people are the Coast Guard's most important 


eet. Leadership has traditionally been important in the 


feercary services to insure the "good order and discipline" 


of these assets. The effective management of these human 


resources becomes even more important as increasing amounts 


aor example, see former Coast Guard Commandant Admiral 


John B. Hayes' State of the Coast Guard address of 16 
January 1979. 
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Ore cime and money are invested in their training and develop- 
ment. This is one of the reasons that leadership and manage- 
ment training is provided to those in supervisory positions. 

The Coast Guard recognizes the need to efficiently use 
these training dollars and has prescribed the responsibili- 
ties and techniques for training management [Ref. 2]. One 
of the techniques is the use of Instructional Systems 
Development (ISD), a method of identifying training needs, 
determining the optimal training methods, developing an 
appropriate training design, implementing and evaluating 
the training. A diagram of the basic ISD process is provided 
by Figure 1.1. 

This thesis will examine the "Problem Solving Skills for 
Managers" training package, developed by Interact Performance 
Brstems, Incorporated, in 1982, and piloted by the Coast 
Guard Leadership School during the period 5 April 1983 through 
12118 1933. The main objective of the training is for 
Supervisors to increase their effectiveness in dealing with 
interpersonal problems in their work settings by using the 
steps in the problem solving process that are described in 
ea raining. In this particular training program, parti- 
wants learn to communicate the situation in a specific 
and non-threatening manner; to diagnose the situation as an 
ability or a motivation problem; to communicate the conse- 
quences--natural (e.g. the job will not get done), to others, 
to the supervisor, or imposed--until compliance 1S gained; 
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to determine who does what/when and set a follow-up date; 
how to find long-term solutions; and how to deal with emer- 
gent problems. The process involves extensive use of video- 
taped modules showing both ineffective and effective 
behaviors, structured role-playing and group discussions. 
The training is given in a series of four one-day segments, 
one segment per week. After each training segment, partici- 
pants "contract" to practice their skills during the week 


and to report their results when the class next meets. 


B. PURPOSE 

Nero urcpose Of this thesis is to accomplish a portion of 
the evaluation phase required by ISD [Ref. 2], and in 
particular the internal evaluation of the "Problem Solving 
Skills for Managers" training package piloted by the Coast 
ward Leadership School during the period 5 April 1983 
through 2 August 1983. (The other phases of the ISD process 
in relation to this training package will not be discussed 
in this thesis and are assumed to have been completed prior 
to this stage.) Internal evaluation refers to an analytical 
means of measuring the instruction process by determining 
Student reaction or degree of behavioral change attributed 
memine actual training-{Ref. 2]. The instruments used to 
measure the instruction process consist of a series of ques- 
tionnaires designed by the developer of the training process. 
The training was conducted by a staff member of the Coast 
Guard Leadership and Management School. The data was 
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collected and a computerized data base established oy the 
leadership school staff. The purpose of this thesis is 
to analyze the data and make a determination of the effec- 


tiveness of the training package. 
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Mie METHODOLOGY 


A. RESEARCH SETTING AND DESIGN 

fies Problem Solving Skills for Managers" training 
package was presented to supervisors at four Coast Guard 
cmm ons in the Twelfth District (San Francisco area) as a 
pilot program with the goal of determining if the training 
should be pursued on a larger scale within the Coast Guard. 
Two stations were trained initially while the remaining two 
stations were used as a "control group." These "control 
eroup' stations subsequently received the same training. 
Ac larity and consistency throughout this thesis, the 
first group to receive the training will be referred to as 
the "Early Treatment Group" and the second group to receive 
the training as the "Late Treatment Group" (see Figure 2.1). 

The first portion of the training design used by the 
Coast Guard Leadership and Management School Project 
Manager/Trainer is referred to as a quasi-experimental, 
non-equivalent control group design [Ref. 3]. It involves 
an experimental group and a control group ('early' and 
"late" treatment groups, respectively), both given pre- and 
post-measures. The early group and late group do not have 
pre-experimental sampling equivalence. These groups consti- 
tute the "naturally assembled collectives" of four Coast 


Guard stations, matched as closely as possible for size 
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(total numbers of people assigned, supervisors and subordi- 
nates combined) and organizational profile (operational 
mission, common group commander, rank of those in leadership 
Besrions within the organizational structure). That is, 
the participants are not randomly selected or assigned to 
these groups as a "true" experimental design would require. 
The assignment of the treatment to one group or another is 
assumed to be random and under the researcher's control. 
The training was conducted at each station by the same 
experienced instructor from the Coast Guard Leadership and 
Management School in Petaluma, California. The data 
collected with the measurement instruments was transcribed 
by the Management School staff to form a raw computerized 
data base. This researcher organized the data base into 
four files, one for each type of questionnaire, for subse- 


quent analysis. 


B. INSTRUMENTATION 

The same pre-measures and post-measures were given to 
each of the control and experimental groups, and consisted 
of a set of four questionnaires that were administered at 
the points in the training design as shown in Figure 2.1. 
These questionnaires were designed by the company that 


developed and produced the training package. 
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me OO a aaae Organization Survey (SUBQ) 

This questionnaire consists of three parts: demo- 
eraphics; subordinates’ perception of organizational 
climate, satisfaction and commitment; and subordinates' 
Meweeption Of their supervisors’ behavior in dealing with 
problems. It was completed by the subordinates of the 
Supervisors who received or were scheduled to receive the 
training at each of the stations. The demographic informa- 
tion section was completed only at the first administration 
SAIs questionnaire. 

2. supervisory Organization Survey (SUPQ) 

This questionnaire also consists of three parts: 
demographics; supervisors' perception of organizational 
climate, satisfaction, and commitment; and knowledge of 
problem solving/organizational support. The supervisors who 
received or were scheduled to receive the training completed 
ADO rtions of this questionnaire at each administration, 
except for the demographics section, which was completed 
era for the first administration. 

3. Multiple Choice Questionnaire (MCQ) 

This questionnaire was completed at each administra- 
tion by each of the supervisors who received or were sched- 
uled to receive the training. It was designed to measure 
understanding of problem solving skills (categorical and 


episodic). 
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Pee ee rv icorvy evaluation of Training (SETQ) 

This questionnaire was completed by supervisors on 
meee aoministration following completion of the training. 

It was designed to measure the supervisors' reaction to the 
training program and their motivation as determined by 
Maemdinsic factors (e.g. recognize the positive natural 
consequences of using the problem solving skills) and 
Pertaimsic factors (e.g. organization support). 

Copies of all four of these instruments are included 
as Appendix A. Each of these questionnaires uses codes to 
identify the subordinates and supervisors within the data 
base for cross-referencing or comparing results based on 
Subordinate or supervisor responses on each variable, while 
mein talilning the anonymity of the participants. The coding 
Des questionnaires is explained in the introduction to 


the appendix. 


C. SAMPLE 

The data collected from these four measurement instru- 
ments was based on a combined sample (N = 111) of subordi- 
nates and a combined sample (N = 38) of supervisors who 
received the training at the four stations. (The subordi- 
nate sample size refers to the number of questionnaires 
filled out at each administration by subordinates; there 
were actually a total of 52 subordinates, some of whom 


completed questionnaires for more than one supervisor.) A 
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portion of the supervisors who received the training and 
completed the Supervisory Organization Surveys were also 
considered to be subordinates and Iilled out the subordinate 
Organization Surveys as well. These dual-role cases were 
096 identified in the data base and could not be distin- 
its ned. This could be a source of contamination of the 
mets noted in this study and will be discussed further in 
chapter four. Table I shows the breakdown of supervisors 


emer subordinates for each unit. 


Table I 


Sample Sizes by Unit and Category 


Category 
Unit Subordinates Supervisors 
100 (0036 . 011 
ESOO 021 007 
C400 028 Ga 
(02600 027 009 
Total | 038 


Note: E identifies the Early Treatment Group and 
C identifies the Late Treatment Group. 


Although the stations selected by the Coast Guard Project 
Manager/Trainer were matched in pairs as closely as possible 
Size and organization profile, this thesis will not 
analyze the data obtained in terms of "matched" pairs of 
units. If matching was to be used as an attempt to 


au 





compensate for the differences between non-equivalent control 
groups when random assignment to experimental and control 
00091. 1 00208 1 not possible, it may not only fail to provide 
the desired equivalence, but in certain circumstances may 
actually assure the presence of unwanted regression effects 
[Ref. 3]. The data samples will therefore be aggregated and 


compared as early treatment vs. late treatment groups. 


D. PROCEDURE 

A number of hypotheses regarding change as a result of 
the training will be examined to determine the effectiveness 
of this training program. Effectiveness can be evaluated in 
terms of reaction, learning, behavioral and/or results 
criteria [Ref. 4]. Each is used to examine different 
aspects of the program. Reaction criteria measure how well 
the participants: liked the program. People are more likely 
to obtain maximum benefit from a program they enjoy. 
Reaction, then, provides one means of identifying reasons 
for the success or failure of a training program. Learning 
refers to the knowledge and skills absorbed by the vartici- 
pants. Behavior is the transfer of the knowledge and skill 
to actual performance on the job. Results criteria can be 
cost-related (lower cost, increased efficiency) or behavioral 
(reduced absenteeism, attrition, disciplinary involvements) 
measures, which give evidence of the training's impact on 


organizational effectiveness. Because of many complicating 
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Berors, however, it is very difficult to evaluate in terms 
OÍ results [Ref. 4]. 
1. Approach 

This thesis will examine the effectiveness of the 
training program primarily in terms of learning and 
behavior. 

a. Learning 

Learning will be analyzed in terms of the 

results of the Multiple-Choice Questionnaire (MCQ). Although 
the Supervisory Organization Survey (third part) also seems 
to measure participant knowledge, it appears to be somewhat 
redundant to the MCQ and will not be examined in this 
analysis. The data base was recoded so that the desired 
answer received a value of one and all other answers a 
value of zero. A score for each participant was then 
computed as a percentage correct of the questions answered. 

Dee Sela vl Or 

Behavior will be analyzed in terms of the 

results of the Subordinate Organization Survey (SUBQ), Part 
III. To determine if any of the fifty variables (questions) 
could be combined and scaled in order to reduce the number 
of data comparisons required, the data from the first admin- 
istration of SUBQ Part III was subjected to factor analysis 
emo principal factoring with iteration and varimax 
(orthogonal) rotation. Nine factors were identified. Using 
the Scree Test [Ref. 5: pp. 152-156], a vlot of Eigenvalue 
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Ee e Or number (see Figure 2.2), it was determined that 
wo actors were the primary contributors. The first two 
eors accounted for most (77.3%) of the variance in that 
data set. Therefore, a second factor analysis was made 
only two factors extracted. The factor loadings from 
the varimax rotated factor matrix were used to assign each 
variable to one of the two factors based on the weight of 
the factor for that variable. In reviewing the questions 
mare lOaded on each factor, it appears that the first factor 
relates to "problem solving support" (where a high rating 
indicates more support) and that the second factor relates 
to "passing the buck" with regard to problem solving (where a 
[evmratving indicates less "passing the buck"). Table II 
provides a listing of the variables assigned to the first 
factor, the corresponding questionnaire question and the 
meme priacre factor loading, in descending order of factor 
loading. Table III provides the same information for the 
second factor. 

The values of the variables included in each 
factor were then combined into an average value for each 
subordinate, so that only two variables would have to be 
examined to describe behavior. A listing of the means and 
standard deviations of each variable and the correlation 


matrix for the input variables are included in Appendix B. 
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FACTOR NUMBER 


Scree Test for SUBQ Part III Administration 1 


20 





taole El 


SUBQ Part III Factor One--Problem Solving Support 


Variable 


SUBQ1090 


SUBQ117A 


SUBQ109J 


SUBQ109K 


SUBQ114B 


SUBQIO9N 


SUBQ109A 


SUBQ117B 


SUBQ118C 


SUBQ110B 


Question 


Does your supervisor take action ina 
timely way to solve complaints you 
Brmmestozhis or her attention? 


Does your supervisor try to find ways 
to make the job easier in the future? 


Is your supervisor supportive in 
solving work related problems you want 
beip with? 


Does your supervisor bring resources 
to bear to help you solve problems 
on the job? 


To what extent does your supervisor 
explain how correcting a problem 
affects the job? 


Is your supervisor quick to follow 
through on problems you bring to his 
or her attention? 


Does your supervisor keep up-to-date 
with the problems you are experiencing 
On tne JOD? 


Is your supervisor concerned about 
making the job less difficult the 
next time you have to do it? 


Can you be sure that your supervisor 
will really follow up to see that the 
problem is solved? 


To what extent is your supervisor clear 
about the facts of problems? 


Pactor 


Loading 


.81498 


75998 


, 68634 


17826 


1 


OLOT 


, 0630 


OEIT 


29 


.74615 





SUBQ114A 


SUBQ109C 


SUBQ109B 


SUBQ118D 


SUBQ112C 


SUBQ109D 


SUBQ116B 


SUBQ116A 


SUBQ112B 


SUBQ112D 


SUBQ119D 


SUBQ119C 


“nen discussing a probiem, to what 

e COn Roes your supervisor clearly 
explain what would go wrong with the 
New =the probo lem weren't corrected? 


Does your supervisor take time to ask 
you whether there are ways he or she 
can help make your job easier? 


Does vour supervisor take time dis- 
Cisse your point of view on your 
work? 


AER Our able vo trust that your 
supervisor will do what the two of 
you have agreed needs to be done? 


Accurately summarize your feelings 
on the matter? 


Does your supervisor come to your 
work area to ask you whether you 
need any help to make your job easier? 


To what extent does your supervisor 
show respect for your ideas and 
abilities on the job? 


To what extent does your supervisor 
treat you in a way that shows he or 

she values your experience and opinions 
on the job? 


Demonstrate by restating that he or she 
fully understands the point you are 
tring to make? 


Carefully listen without arguing or 
becoming upset? 


When dealing with an upset subordinate, 
to what extent does your supervisor ask 
the person what is bothering him or her? 


When dealing with an upset subordinate, 
to what extent does your supervisor ask 
what has made the person upset or angry? 


~ 14556 


. 74553 


. 73488 


. 72400 


169524 


OSOL 


"65007 


.64727 


.64726 


‚64267 
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5UBQ120B When you have done a good job, to o O 
what extent does your supervisor 
express his or ner appreciation 
for what you have done? 


SUBQ110A When your supervisor brings up a 90999 
problem, to what extent is he or she 
cere bou exactly what is bothering 
MiM Or Ner? 


5085901124 Listen to your point of view without . 04005 
wae err rupee OI CUttIing you off? 


Table III 


SUBQ Part III Factor Two--Passing the Buck 


NIELOr 
Variable Question Loading 


SUBQ113B To what extent does your supervisor SES 
"Shoot from the hip" when solving 
problems instead of stopping to learn 
about the problem first ? 


SEBOLT13C To what extent does your supervisor 13308 
blame you tor problems that aren't 
Vour fault? 


SUBQ111B To what extent does your supervisor . (2942 
draw conclusions about you as a person 
when discussing problems? 


SUBQI111A To what extent does your supervisor 82001 
put you down when describing problems? 


SUBQ115B When answering questions about why .69934 
something must be done a certain way, 
to what extent does your supervisor 

= threaten you with what might happen if 
you don't do what he or she wants? 


SUBQ109G Does your supervisor give you excuses .68467 


for not solving that show you he or she 
VOI OTROS. Tor you? 


28 





SUBQ109M 


SUBQ113A 


SUBQ11 3D 


SUBQ121A 


SUBQ121B 


SUBQ119A 


SUBQ115C 


SUBQ109P 


SUBQ118B 


SUBQ120A 


SUBQ119B 


Does your supervisor promise to see what 
can be done about a probiem but then 
never let you know what he or she did to 
solve it? 


To what extent does your supervisor 
impose a solution to a problem without 
oi Kospıng tor-fjcsure Out what is 
goling on? 


When discussing a problem with you, to 
what extent does your supervisor assume 
you're the cause of the problem when 
you're not? 


Does your Supervisor act in ways 
that make it hard to trust him or 
her? 


Does your supervisor tell you whatever 
he or she thinks you want to hear in 
order to get you to do what he or she 
wants? 


When dealing with an upset subordinate, 
to what extent does your supervisor 
get angry at him or herself? 


When answering questions about why 
something must be done a certain way, 
to what extent does your supervisor use 
his or her "stripes" as your supervisor 
to get you to do what he or she wants? 


Does your supervisor get on your case 
teszmuensabeout little things that are 
not worth the time they'd take to fix? 


Is it left unclear as to who will do 
what to solve the problem? 


When you have done well on the job, 
to what extent does your supervisor 
express his or her appreciation for 
what you have done? 


When dealing with an upset subordinate, 


to what extent does your supervisor get 
into an argument? 


29 


.66854 


.66449 


130300 
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SUBQII5A 


SUBQ118A 


SUBQ109L 


SUBQ1091 


SUBQ109F 


SUBQ109H 


SUBQ109E 


tional effectiveness is to measure the ee 
organizational ciimate, 


if they change after training. 


When answering questions about why 
something must be done a certain way, 
to what extent does your supervisor 
aude: onu 69009 it the way he or 

she wants? 


Does your supervisor leave you guessing 
about what should happen next? 


Does your supervisor say he or she will 
take action on a problem but then never 
get back to you to solve it? 


Does your supervisor refuse to take 
on the people in power in order to 
remove complaints in your department? 


Does your supervisor fail to deal with 
problems before they become severe? 


Is your supervisor unwilling to argue 
60200 0911 you to Solve problems 
you bring up? 


Does a problem have to get out of hand 


before your supervisor chooses to deal 
With It? 


Results 


SDI LST 


als 


A oO 


2520239 


.45610 


TOAS 


One method of examining the impact on organiza- 


views on 
satisfaction and commitment and see 


The Subordinate Organization 


Survey Part II and the Supervisory Organization Survey Part 


II ask questions in these categories (see Appendix A) which 


are similar to some of the questions in the related sections 
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subordinates who were measured on these factors. 
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meine Michigan Survey of Organizations [Ref. 6]. Again, in 
emmer ort to determine the possibility of simplifying the 
meee base, the variables in SUBQ Part II Administration i 
Were subject to factor analysis using principal factoring 
Meee iteration and varimax (orthogonal) rotation. The 
results indicated that the questions relating to organiza- 
tional climate could be considered as a single factor. For 
Peastiaction, SUBQIO7E (satisfaction with pay) was not 
related to the other variables, so it was not included in 
the scale for satisfaction (the other items accounted for 
78.7 percent of the variance). For commitment, the results 
indicated that the three questions could be considered one 
factor. Although the scree test was inconclusive, Guttman's 
procedure [Ref. 5: p. 147] for estimating the lower bound 
for the number of factors suggests using the factors with | 
eigenvalues greater than or equal to 1.0, leading to the 
selection of one factor for commitment. The scree test 
mous are shown in Figure 2.3, Figure 2.4 and Figure 2.0. 

A listing of the eigenvalues, means and standard deviations 
of each variable and the correlation matrix for the input 
variables are included in Appendix C. These factors were 
applied for each administration of both SUBQ Part II and 
SUPQ Part II. The values of the variables included in each 
factor were then combined into an average value for each 
respondent so that only three variables would have to be 
examined to describe "Results." 
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Figure 2.4 
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2. Hypotheses to be Tested 
Figure 2.6 shows the relationships to be examined. 
In each case, the null hypothesis (Ho) is that there is "no 


change." Each hypothesis will be described in detail below. 


FO: OO 





Figure 2.6 Hypotheses to be Tested 


a. Hypothesis A 
Dita sis tests tor the eltect of training 
on the "early treatment group,' the first set of stations to 


receive the training (see Figure 2.7). 





Figure 2.7 Hypothesis A 


Since the early and late treatment groups are non-equivalnet, 
not randomly assigned, the difference in ratings on the 
various measures could be due to a regression effect. A 
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memoarison Of Simple difference scores may therefore be 
misleading. What is needed is to compare the results 
actually attained with the results that would have been 
attained under the appropriate null hypothesis of no treat- 
Mum rtiect [Ref. 7: p. 25]. To account for this, a method 
of estimating the no-treatment result for the experimental 
(early treatment) group will be used. The results of 
the late treatment group's second administration of the 
questionnaire of interest will be regressed on the results 
Sethe late treatment group's first administration, producing 
a constant and an unstandardized regression coefficient. 
These values will be applied to the actual results of the 
Brest administration for both the early and late treatment 
sroups to obtain a predicted value for the second administra- 
tion. These predicted values will then be subtracted from 
the actual values to obtain the difference or residual 
values. These residual values will then be compared between 
the late and early treatment groups by means of a t-test. 
Hypothesis A can be broken down into analyses 
between the late and early treatment groups for SUBQ Part III 
Beever One, SUBQ Part III Factor Two, SUBQ Part II Factor 
One, SUBQ Part II Factor Two, SUBQ Part Il Factor Three, 
eeeo Part II Factor One, SUPQ Part II Factor Two, and SUPQ 
Pare tl Factor Three. These comparisons and the statistical 


techniques used are Summarized in Table IV. 
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b. Hyoothesis B 
This analysis tests for the effect of training 
Nite "late treatment group," the second set of stations to 


receive the training (see Figure 2.8). 


주 A A O A A A A 주 주 고 주 주 A e A O A A A eS ee O O CA oe 
+ GS ae a= == 





Figure 2.8 Hypothesis B 


In this situation, the regression effect iS assumed to have 
taken place between the first and second administration 
[Ref. 8]. Hypothesis B can be broken down into analyses of 
the same variables as Hypothesis A, but comparing between 
memanistration 2 and administration 3 for the "late treat- 
ment group." These comparisons are summarized in Table V. 
c. Hypothesis C 

This analysis tests for the longitudinal effect 
of training for the "early treatment groups," between the 
Zier tWO administrations after training (administration 2 


paceadministration 3), as shown in Figure 2.9. 
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Figure 2.9 Hypothesis C 


This analysis also assumes that the regression effect has 
taken place between the first and second administrations. 
Hypothesis C can be broken down into analyses of the same 
variables as Hypothesis B; these comparisons are summarized 
im Table VI. 
ad. Hypothesis D 

This analysis tests for the longitudinal effect 
of training for the "early treatment groups," between the 
mist tuwo administrations after training (administration 3 


moeeadministration 4), as shown in Figure 2.10. 


Figure 2.10 Hypothesis D 
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This analysis also assumes that the regression effect has 
already taken place. Hypothesis D can be broken down into 
analyses of the same variables as Hypothesis C; these 
comparisons are summarized in Table VII. 
e. Hypothesis E 

Pais analysts tests for the longitudinal effect 
of training for the "late treatment groups," between the 
CWO administrations after training (administration 3 


and administration 4), as shown in Figure 2.11. 


Figure 2.11 Hypothesis E 


This analysis also assumes that the regression effect 
has already taken place. Hypothesis E can be broken down 
into analyses of the same variables as Hypothesis D; these 


comparisons are summarized in Table VIII. 
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Desert Urs 


Pee REGRESSION RESULTS 

The study of the effect of the training on the early 
treatment groups was based on a comparison of the residuals 
developed from the regression analysis procedure discussed 
in chapter two. The regression analysis provided the values 
Mene coefficient "b" (slope) and the constant "a" (inter- 
cept) in the regression equation for each sub-hypothesis 
Meseribed in chapter two. In addition, analysis of variance 
provides an "F-ratio" which describes the strength of any 
linear relationship between administration one and adminis- 
tration two for the sub-hypotheses of interest (for the early 
treatment groups). Table IX provides a summary,of these. 
values. The null hypothesis is that the slope = O, that 
there is no relationship. A statistically significant rela- 
tionship justifies using the regression procedure. Except 
mere Subordinate perception of supervisor ‘passing the buck!" 
and "Multiple-Choice Questionnaire Score," a signifi- 
cant linear relationship is shown for each sub-hypothesis. 
For the non-significant items, a t-test can be used to 
determine if any differences exist between the early and 


late treatment groups' actual ratings on these items. 
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B. HYPOTHESIS A 

The first hypothesis examined was the null hypothesis oft 
Momcraining effect on the early treatment group, as deter- 
mined by a t-test between the residuals of the ratings for 


the early treatment group and the late treatment group at 


Mmi stration two. See Figure 3.1. 
mC) * @ QO © 
HCA) 


Figure 3.1 Hypothesis A 


The results of these tests are shown in Table X. The column 
labeled "means" refers to the’ mean value of the differences 
between the actual and predicted scores (difference, or 
residual, equals the actual score minus its predicted score). 
This difference is negative if the actual score is less than 
the predicted score. When this happens for the group that 
received the training, it indicates that the training has 
caused a reduction in the score used in the test of the 
sub-hypothesis. If the difference is positive, it indicates 
that the training has caused an increase in the score. For 
those items showing a significant linear relationship for 


the late treatment group between administration one and 
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Maministration two, as discussed in the previous section, a 
memearison ot the difference, or residual, means between the 
early and late treatment groups provides a measure of the 
Significance of any changes noted. Table X shows the 
results of these comparisons. For those items not showing a 
Peniticant linear relationship for the late treatment group 
between administration one and administration two, a compar- 
ison of the actual scores (for example, using a t-test) is 
appropriate. Table XI provides the t-test results for these 
items, as well as t-test results for the other sub-hypotheses 
for comparison with the regression results. 

As shown in Table X, sub-hypotheses 3, 4, 5 and 6 indi- 
cate significance at least at the .069 level. Multiple-Choice 
Questionnaire Scores are above the predicted scores for the 
Ze Lreatment group, indicating that training had a posi- 
tive impact on supervisors' knowledge of the problem solving 
process. (As would be expected, because the linear rela- 
tionship between administration one and administration two 
for the late treatment groups' Multiple-Choice Questionnaire 
Scores was not significant, the t-test on the actual Scores 
provided similar results. See Table XI.) Subordinate 
Mereeeption of organizational climate, satisfaction and 
commitment all show a significant decrease for the early 
Meeatment group (p 2 .065), indicating that the training had 


a negative impact on these ratings. 
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fee HYPOTHESIS B 

The second hypothesis examined is the null hypothesis of 
no treatment effect on the late treatment group, as deter- 
mined by a t-test on the ratings between administration two 
(immediately before the training) and administration three 


(immediately after the training). See Figure 3.2. 





Figure 3.2 Hypothesis B 


The results of these tests are shown in Table XII. In this 
and the remaining tables, "means" refers to the means of the 
actual scores or ratings. Most of the means show the appro- 
priate trends, but none except Multiple-Choice Questionnaire 
Score are significant below the .124 level. Multiple-Choice 


MMestionnaire Score is the most significant (p > .087). 


BESZHYPOTHESIS C 

The third hypothesis examined is the null hypothesis of 
no longitudinal change in the ratings for the early treat- 
ment group for the two administrations immediately following 


training (administrations two and three), See Figure 3.3. 
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Figure 3.3 Hypothesis C 


This analysis determined whether the after-training scores 
either declined or increased over time, and the significance 
of any differences. The results of this analysis are shown 
in Table XIII. The most significant difference is for 
sub-hypothesis six, subordinate commitment, which has 
increased from administration two to administration three 
g. B2). | 
fee HYPOTHESIS D 

The fourth hypothesis examined is the null hypothesis of 
no longitudinal change in the after-training ratings for the 
PAY treatment group for administrations three and four. 


see Figure 3.4. 


Figure 3.4 Hypothesis D 
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This analysis determined whether the after-training scores 

elther declined or increased over time, and the significance 
Sieany differences. The results of this analysis are shown 
metab le XIV. The most Significant result (p > .211) is for 
sub-hypothesis nine, supervisor commitment, which increased 


meme administration three to administration four. 


fee HYPOTHESTS E 

The fifth hypothesis examined is the null hypothesis of 
no longitudinal change in the ratings for the late treatment 
group between the last two administrations following the 


meaning (administrations three and four). See Figure 3.5. 


Figure 3.5 Hypothesis E 


This analysis used the same methodology as used for 
Hypothesis D. The results are shown in Table XV. The most 
Significant result is for sub-hypothesis six, subordinate 
memmiument (p = .113), which has increased from administra- 


mom three to administration four. 


55 





Table x1V 


30.9235 
59.47/01 


ul enle=-chorc> 
Ges vzonnaizs> 은 
Score 

SUD dia te 
Coon en Of 
oman Zat iona 


ㅣ 
UJ 
e 

KO 
O 
‘£2 
NO) 


we et Se co ce ee ee ey Se ee es a et ce EEE S D a e cc, EEE u ~ ee 
FS 


Ccom1tment 


| ES 
| H (D7) Supervisor Per- 
| Cep- Jon of 3.933116 
| Gegaen-zaticra i Soe) 2.0 1s 108 
| Climate Da 3 
| H (D8) Supervisor 4.6557 
| Sau. es fact LeOn - Sr? 
| 4.7389 
foo) Supervisor 37778 
| Commitment zul. a ne 
| 4.3148 
| = mo oo oo |. | zo zo om oo man m mn a mem m nm m mn m mm m mn m u m mm no mm m m mn mn 
| 
| 
o ces: —"d.t.'" refers 0 degrses of fzescdon. T-Value 
| aoe ooo warden t, C—-Sctet Stic. 
| fot eee eS Ee) Mes. Sigaifticent i*~ems. 
| 
| 
| 
| 
| 
| 
ns 


al 
O) 


T-Test Results for Sub-Hypotheses of R(D) 
Nuli Hypothssis: Mans: | P 
No change ostween Admin D= E E Y 
administrations 2 values en. 
Beare G oz fhe =e 
MESE Ly" guns > 
DA) Subordira“tz ner- da. 
Ee- DE Orr Np ro- nano, 2 
a o Nrc n nn Deo Fan 26 oT 
ry ad SULDO" 4.5540 
AND2) Subordinate P22- 
CEO Oe owe Su DST = 2a) 
OPa Scng o 1.097 95 2 
“¿hs Buck" Zo S 


> ab “me "E ae an e Pp ab y eee eee See O A A O eee ee eae O O O O A eee ee ~ eee Y a a e e eee ci M M = = Y A O A TO O Y ee oe 


WE WM A O O A A A AU A O A A = O A O A Y A O A = O AY = - O A A TO A Y A A O A = ~ - = ~ ~ = O ee ee ee ee A D 


Citmate 322228 

H(D5) Subordinate 4.4950 
SES Ta COn -.28 95 .783 

SA 

A(D6) Subordinate 32.720) 


| 
| 


ee CS GE dd “aus ee SE!) oralen | ide mr Mr She An 3 


nn 


-a a atl Bee un a ee ee A EEE rin EL eg ar ren 


 — ie A re te i ci het. m sd 


Kin tn en A nn ee nn EEE ee a, DÍ, nn En a D a 0022. a 002. 00. 2 46 min te 





me see ma OE AS SS A EEE ES A AS SS A AS A A A SS A AS A AP RE AD ED ee ie, Armen EAE 


-w a TD Y TO A ae Pe ae ~ a TA Ga WD TD A A A A TU A A A A SSS 2 A A A A TO A AY TO ~ 0 0 E A” A TO TY A O TO TO TO A TO O Se 


-e Y A A A 0 SE UD A O AY TD A TO A O A O A A A A A A 0 A A A A AY A A A O A A A O Ay TO A Ay TO O A A O A A Se Se a 


WED A A E O ~ ~ 2 eee se See y A TU y ~ ~ ~ AY A A O A A A A ~ TO A TO A A A A A A ~ 0 ~ ~ O AY A a O A A O oe 


SIA 
Piles results tio subo ypotheses of H(E) 


Hypothesis: 
hanhqs oe tween 
Aimar ios 

wu rore he 

== vu pS 

Spor dunes eps: 
Cape ON ACES dos > 
Tee PTOL 
Solying SUPROT! 


visor "Pa 
tha Buck" 
Nur plerchorcs 


Questionnaire 
score 


SüBbər dinate 
CET ION 


| > ' 
Super dinate 


Commitment 


Supervisor Per- 
Cepe on Of 

adan zas zonal 
ima => 

SUS ISO ~ 
Sais 2302 207 


SO = E V1SO0z 


_ | 다 


4.8142 


2.3942 
225180 


4.4203 


4.2770 
4.4135 
4.6526 
422053 


A SS ee, ED pee, ARTE EEE eee) SE Ls A A A A en nn 


pl es ED oe iS ete SS ete A D A AS 


| 
| 
| 
| 


O1 
~] 





IDO SEUS 


n 
A 
O 

4 


fee ENTRODUCT ION 

FB ementioned ın chapter two, the first portion of the 
research design developed for this project is described by 
Campbell's and Stanley's Design 10 [Ref. 3: pp. 46-50], a 
quasi-experimental non-equivalent control group design, 
which they state is one of the most widespread experimental 
designs in education research. The more the experimental 
maA control groups are similar in their recruitment and the 
more this similarity is confirmed by scores on a pre- 
Mare, the more effective this design is in controlling 
MN thne main effects of history, maturation, testing and 
entation. One area of concern in this design is that 
of intrasession history. Since all of the subjects in each 
of the experimental groups are measured in two separate 
sessions, and the same for the control groups, the irrele- 
vant unique events in any of these sessions become rival 
hypotheses for explaining any pre-measure/post-measure 
differences for the two early treatment groups, the two late 
treatment groups or between the combined "early" groups and 
the combined "late" groups. Another major concern affecting 
internal validity is that of interaction effects of selec- 
won and such extraneous factors as history, maturation and 


testing. In general, these interactions are unlikely, but 
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must be considered in the analysis. Regression can provide 
another source of internal validity problems in this design, 
Specially if a matching procedure is used that results in 


substantially different group means. 


B. INSTRUMENTATION 

Four sets of guestionnaires were administered during 
eme training program to the supervisors or the subordi- 
nates, as appronriate, each attempting to measure some 
portion of the training effectiveness criteria (learning, 
behavior, reaction and results) discussed in Chapter Two. 
Since the main objective of the training program was to 
change supervisors' behavior to be more effective in dealing 
with problem-solving situations, the measures of the subor- 
dinates' perceptions of supervisors' behavior in using 
problem-solving skills is of primary interest. The measure- 
ment was done with the Subordinate Organization Survey (SUBQ) 
Dil. To simplify the analysis, this data was subjected 
w factor analysis and two factors were identified. One of 
the problems with aggregating data in this manner is the 
inability to diagnose specific strengths or weaknesses of 
the training program. Data aggregation is more useful, 
however, to explain why the overall results have occurred. 
The primary purpose of this thesis is to determine the 
overall effectiveness of the training program, so using the 


aggregated data appears to be appropriate. The factors 
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identified do seem to make sense and to be combining vari- 
ables measuring similar properties. The factor analysis was 
road on data from tne first administration for the late. 
treatment group, and the same factors were used for all 
administrations for each group. The other data sets were 
used to assess the criteria of learning, reaction and 
results in order to explain the behavior ratings. Part II 
of the Subordinate Organization Survey and Supervisory 
Organization Survey measure some of the results criteria, 
weas organizational climate, satisfaction and commitment. 
The variables associated with these items were subject to 
factor analysis, with the result that one factor for each 
category was found to be appropriate. The disadvantage of 
aggregating the data, as noted earlier, is the inability to 
pinpoint a specific weakness for diagnostic purposes. The 
Multiple-Choice Questionnaire (MCQ) a T 
knowledge of the problem-solving process and was scored on a 
right/wrong basis for each question. This researcher 
completed the questionnaire after reading the descriptive 
Material for the training program, including the trainer's 
guide, and selected all the answers subsequently identified 
as correct by the company which developed the training 
package, providing a measure of face validity for the ques- 
tionnaire. By measuring the supervisors' learning (change 
in knowledge) of the problem-solving process after training, 
one source of behavior differences can be analyzed. The 
Supervisory Evaluation of Training Questionnaire (SETQ) 
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provides a measure of supervisor reaction to the training as 
wet as 2 measure of intrinsic motivation and extrinsic 
01 . Since this questionnaire was given only once 
emmediately after training) for each group, the only 
comparisons possible are between the early treatment group 
ac administration two and the late treatment group at admin- 
istration three. These comparisons could be affected by the 
fact that the late treatment group completed the survey one 


month later than the early treatment group. 


C. SAMPLE 

The data comparisons are based on relatively small 
sample sizes, which affect the generalizability of the 
meeuits to the population of all Coast Guard supervisors. 
Mm addition, the results may be contaminated due to the fact 
that subordinates usually rated more than one supervisor 
and that each supervisor was usually rated by more than 
one subordinate. This could, however, serve to increase 
the reliability of the overall ratings because of the 
multiple measurements for each supervisor. The area of 
greatest concern about contamination is the fact that some 
of the supervisors who received the training also completed 
surveys as subordinates. This could tend to bias the 
results, although the direction of bias is not predictable. 
The supervisors who are also subordinates and were exposed 


wne training could be either more critical after training 
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or more perceptive of the changes in their supervisors' 
behavior. The validity of this means of measuring supervi- 
sors' behavior is somewnat suspect. It is, however, the 


only measure of behavior available in this analysis. 


D> REGRESSION PROCEDURE 

The regression analysis described in Chapter Three, 
mote IX, indicates a linear significant relationship 
(p 2 .0060) between administration one and administration 
two for the late treatment group with respect to all sub- 
hypotheses of interest except sub-hypothesis two (subordi- 
nate perception of supervisors 'passing the buck" with regard 
to problem solving, p > .1328) and sub-hypothesis three 
(multiple-choice questionnaire score, p > .8813). For these 
sub-hypotheses, application of the regression procedure would 
not be B e cantly different from measuring directly the 
differences in the actual scores between early and late 
treatment groups. The regression procedure used assumes 
that the initial means and standard deviations of the early 
and late treatment groups are the same. If this is not the 
case, results would be erroneous. A comparison of the 
actual score means for each sub-hypothesis found that the 
means and standard deviations did not differ significantly 
Sup 2 .05). Subordinate satisfaction and supervisor 
commitment showed the most significant differences p > .134 


and p > .100, respectively) between the means, and 
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subordinate satisfaction the most significant difference 
(p > .043) between the standard deviations. This will 

Be considered in the discussion of the results of the 
comparisons of subordinates' satisfaction and of supervi- 


sors' commitment ratings. 


Pee RESULTS 
il. Behavior Criteria: Early Treatment Groups 

Hypothesis A examined the relationships between the 
early and late treatment groups after applying the regres- 
sion procedure in the case of each of the sub-hypotheses of 
interest. It was found that subordinate perception of 
Supervisors' behavior was not significantly different after 
training for either of the two factors examined. The most 
meet icant factor, "problem solving support" (p > .110), 
Bowed a decrease in the mean score, indicating that immedi- 
ately after completion of the training subordinates felt 
that the supervisors' paneer was less effectively applied 
to problem solving than the behavior of the untrained super- 
visors. This result could be partially due to the subordi- 
nates having higher expectations of their supervisors after 
completing the 4-week training package, Since they were 
aware that the supervisors were being trained and in fact 
some of the subordinates were also considered to be supervi- 
sors and received the training. The training could have 


made them more aware of the problem solving process and of 
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My differences between the ideal and the actual behaviors. 
This hypothesis can be viewed as a "negative Hawthorne 
efttect," affecting the external validity of the results, 

as well as resulting in instrumental decay [Ref. 3] (the 
instrument no longer is measuring behavior with the original 
criteria), one of the conditions which affects internal 
validity. Although the results obtained indicate that the 
mning had no significant impact on subordinate 

perception of supervisors' behavior, there are enough rival 
hypotheses to investigate as possible explanations of these 
Mmesults that a firm conclusion that the training is not 
effective is not possible without further study. For 
example, the validity of using the Subordinate Organization 
Survey Questionnaire instrument as the measure of supervisor 
behavior is suspect because of the factors mentioned above. 
In addition, there could still be differences in long-term 
behavior ratings, which were examined in Hypotheses C and 

D. In testing each of these hypotheses, however, there was 
no significant difference in supervisors' behavior. 

Another possible explanation is that the impact of 
training differed between the early treatment groups. 
Further data analysis was done comparing the regression- 
adjusted means at administration two for groups E3 and ES 
(see Figure 2.1) that showed a difference for the second 
Error ("passing the buck," p > 0.010), with the mean for 


group E3 decreasing (as desired for this factor) but 
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increasing for group ES. There was no difference for the 
mest factor. <A t-test comparing the means of the actual 
Enes for group E3 between administration one and adminis- 
meation two showed a significant decrease (p > 0.006) for 
fais second factor (not adjusted using regression proce- 
dure). Based on a comparison of the residuals t-tests and 
the actual-ratings t-tests of Hypothesis A (Tables XI and 
hil), it is believed that this strongly significant result 
would remain significant after the regression-procedure 
adjustment. There is no Significant longitudinal change for 
group E3 on this second factor for the last two administra- 
Bene, indicating that the training may have a lasting 
Baer on this factor for group ES. In terms of behavior, 
this M ult WHAI cates that the training was er Tor 
one group on one factor, but overall made no difference. 
This information is useful for diagnostic purposes, but 
further discussion is beyond the score of this thesis. 
Another possible explanation for the lack of training 
impact on the early treatment group compared with the 
late treatment group at administration two could be related 
to demographic differences. Table XVI shows the mode for 
each of the categories of subordinate demographic data 
collected on the Subordinate Organization Survey Question- 
naire (SUBQ, Part I) and for the supervisors, collected 


on the Supervisory Organization Survey Questionnaire (SUPQ, 
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Part I). A t-test comparing the means of the early and late 


treatment groups for each of these categories showed no 


Sreniticant differences. 
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2. Behavior Criteria: Late Treatment Groups 


Hypothesis B examined the relationships between the 
early and late treatment groups' actual score means for the 
sub-hypotheses of interest. As shown in Chapter 3, Table 
X1I, subordinates' perception of supervisors' behavior did 
not change significantly after training for either of the 
two factors examined. This result indicates that supervi- 


sors' behavior was not affected by the training program. As 


66 


en ee ee ae oe ey OS a 


Aldo. EI mu. ihr men TR me um 





discussed in the preceding section, however, there are many 
rıval hypotheses to explain why training did not appear to 
have an impact on behavior. These include rising expecta- 
tions from the subordinates and their changing understanding 
of what is the ideal standard of behavior compared with 
reality ("instrumental decay"). The same possibilities for 
contamination exist for these late treatment groups as for 
the early treatment groups as discussed in the preceding 
section. 

The study of the longitudinal effects of training on 
Supervisor behavior were examined in Hypothesis E, with no 
Significant difference detected for the combined late treat- 
ment groups. Further data analysis was done to examine the 
iv al M o cthesis © diferential impact of training on the 
late treatment groups. It was found that group L6 showed a 
ei icant increase (p > .055) in the ratings for factor 
one, "problem solving support." No significant differences 
were noted for group L4 on either factor or for L6 on the 
second factor. No significant longitudinal difference was 
noted for group L6 on factor one between administrations 
three and four, indicating a possible long term effect for 
this factor. As with the early treatment groups, this 
result indicates that the training was effective for one 
group on one factor, but overall made no difference on 
Subordinate perception of supervisors' behavior. Further 
Study to determine why there is a differential effect would 
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be useful for diagnostic purposes, but is beyond the scope of 
this thesis. 
wee earning Criteria 

If the training made no difference on supervisor 
behavior, a logical first step toward explaining why is to 
examine learning, the increase in knowledge as measured by 
the Multiple-Choice Questionnaire. Sub-hypothesis H(A3) 
examined the difference in knowledge after training for the 
early treatment group and sub-hypothesis H(B3) examined the 
differences for the late treatment groups. AS shown in 
Chapter 3, Table X, there was a significant increase for the 
early treatment group (p > 0.010). For the late treatment 
groups, Table XII shows an increase significant at only the 
0.087 level. The mean scores, however, appeared to be 
fairly low. The mean score for the early treatment group 
was only 59% (9 of 15 correct) and for the late treatment 
up was 53% (8 of 15 correct) after training. Group E3 
showed a significantly higher mean score (p > .100) than 
mmeup E5 (67% vs. 47% correct) after training. For the late 
treatment groups, C6 showed a Significant increase in knowl- 
edge (at the .029 level) to 70% correct, while L4 showed no 
Significant increase and a mean score of 37% after training. 
These results follow the results in the previous sections, 
indicating that the training was effective for groups E3 and 
L6, but overall was ineffective. Although when this number 


of hypotheses are tested some are bound to be significant by 
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때, it is Telt that the consistency of this particular 
Anding (both behavior and knowledge were found to be 
enit icantily higher for groups E3 and L6) gives it more 
eredibility than it might otherwise merit and should be 
considered for diagnostic purposes. 

E. Results Criteria 

Results criteria in terms of subordinates' and 

supervisors' views of organizational climate, satisfaction 
and commitment to the Coast Guard were measured by Part II 
of both the Subordinate Organization Survey and the 
supervisory Organization Survey questionnaires. For the 
early treatment groups, sub-hypotheses H(A4), HCAS) and 
HCAG) examine the results criteria for subordinates, and 
sub-hypotheses H(A7), H(A8) and H(A9) examine these criteria 
Beeethne supervisors. As shown in Table X, there is no 
significant change for the supervisors on these criteria, 
but forthe subordinates there is a significant decrease 
immediately after training for all three categories. 
Hypotheses C and D examined the longitudinal effects for 
these sub-hypotheses. At administration three, as shown in 
Table XIII, subordinate commitment shows the most signifi- 
cant change (p > .172), moving slightly upward. At adminis- 
tration four, as shown in Table XIV, supervisor commitment 
shows the most significant change (p > .211), also moving 
Slightly upward. In summary, for the early treatment 


groups, there appears to be no change for the supervisors 
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and a negative change for the subordinates in terms of the 
Sults criteria. 

For the late treatment groups, sub-hypotheses H(B4), 
H(B5) and H(B6) examine the results criteria for subordi- 
nates and H(B7), H(B8) and H(B9) examine the criteria for 
the supervisors. AS shown in Table XII, there is no signif- 
icant change in any of these cases immediately following 
training. Hypothesis E examines the longitudinal effects 
for these sub-hypotheses. As shown in Table XV, subordinate 
commitment shows a slight increase (p > .113) for adminis- 
mation four. 

These results indicate a difference in the reception 
by the subordinates between the early and late treatment 
groups. Perhaps the implementation of practice of the 
problem solving skills was handled differently between the 
early and late treatment groups. Further study of this 
issue, as well as investigation of possible differential 
effects between the "early" groups and between the "late" 
groups, would be useful for diagnostic purposes. Within the 
scope of this research, it appears that training has not 
had a positive impact on these results criteria, and for the 
early treatment group, the impact on these criteria has been 


negative. 


F. CONCLUSIONS AND RECOMMENDATIONS 
The overall results of this analysis indicate that the 


training package was not effective in changing the 
TO 





Sime rvisors’ behavior; it had moderate success in teaching 

a knowledge of the problem solving process; it had a negative 
때. On Subordinate perception of organizational climate, 
Pperstaction and commitment to the Coast Guard for the early 
treatment group and no significant impact on these criteria 
for the late treatment group. Figure 4.1 through Figure 

4.9 provide a summary of the results of the study of the 
sub-hypotheses considered in this analysis. A "+" or 

f= indicates the direction of change. Without further 
study investigating the reasons why behavior change did not 
Occur for all treatment groups, the results of this study 
suggest that the U.S. Coast Guard implementation of this 


training package should not proceed. 
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Figure 4.3 Multiple-Choice Questionnaire Score 
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Figure 4.4 Subordinate Perception of Organizational Climate 
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Figure 4.6 Subordinate Commitment 
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Figure 4.7 Supervisor Perception of Organizational Climate 
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Figure 4.8 Supervisor Satisfaction 








Figure 4.9 Supervisor Commitment 
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APPENDIX A 


QUESTIONNAIRE CODING 


Er ZZ INTRODUCTION 

This appendix relates the four survey instruments used 
momstudy the effectiveness of the "Problem Solving Skills 
for Managers" training package to the variable names and 
value labels assigned to the SPSS System File developed to 
facilitate the analysis. Four separate files were 
established, one for each survey instrument. They are: 
SUBQ (Subordinate Organization Survey); SUPQ (Supervisory 
Secanization Survey); MCQ (Multiple Choice Questionnaire); 
wS ETO (Supervisory Evaluation of Training SEO Seon 

Fa zeuestionnasres were administered according to the 


following schedule: 


tation E300 A1 x A2 AS A4 
Station E500 A1 xX A2 A3 A4 
Station L400 A1 A2 X A3 A4 
Station L600 A1 22 x A3 A4 


A1 refers to the first administration, A2 to the second 
administration and so on. SUBQ, SUPO, and MCQ were filled 
Mat all four administrations. SETQ was filled out only 
in the administration immediately following treatment 


(designated by "X"). 
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B. SUBORDINATE ORGANIZATION SURVEY 

This auestionnaire was given to subordinates of the 
supervisors who were trained or scheduled to be trained as 
part of the study to measure how supervisors in the Coast 
Guard work with their subordinates. The first five ques- 
tions asked for some biographical data of the survey 
respondents. SUBQ106A through SUBQIOSC asked for the 
subordinates' attitudes or opinions about what it is like 
to work in the Coast Guard. The remaining questions dealt 
specifically with how the subordinates' supervisors and 


Others work with them. 


ed 








INTERACT PERFORMANCE SYSTEMS, INC. 
SUBORDINATE ORGANIZATION SURVEY 
IMPORTANT PLEASE READ 


This questionnaire is being given to you as part of a study to measure how 
supervisors in the Coast Guard work with their subordinates. There are 
three parts to this questionnaire. Part I asks you some basic questions 
about yourself. This helps us make sure that different units in the Coast 
Guard are included in a fair way. Part II asks for your attitudes or 
opinions about what it's like to work in the Coast Guard. Part III asks 
very specific questions about how your supervisor and others work with you. 


All of your answers will be strictly confidential. Only the researchers at 
Interact Performance Systems will have access to your questionnaire. 


This questionnaire will be repeated in a few months, and we would like to 
learn your views at both times. In order to follow your responses over the 
months and at the same time,make sure you remain anonymous, we ask that you 
code each questionnaire in the following way: 


1. Print the first letter of your Mother's 
first name. © è o o% o o% ò% 8 . . ò ò ò o Dy 


2. Print the first letter of your Father's 


| 


3. Print the two numbers which represent the 
day of the month of your birthday . . Tu (17-20) 


Please note example: 


If your mother's name is Mary SMith. . . . . ve 


ES 


1f your father's name is Robert Smith put an R 
in the space. Please do not put a B even if his 
Diceknane IS BoD De een ie 


| 


If you were born on the 16th of the montb. . - ㅡ ~ 


Ir 
10 


Or if you were born on the Sth of the month. . .——» 


(O 


5 


(Please include a zero in the first space if you were born before the 


lOth of the month.) 
Reprinted With Permission 


Copyrignt, interact Performance Systems, Inc. 1982 
All Rights Reserved 


Name of your current supervisor: 
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INSTRUCTIONS 


1. Most questions can be answered by choosing one of the answers given. If 


you do not find the exact answer that fits your case, choose the one 
that is closest to it. 


2. Answer questions by circling the number of your answer choice, as shown 
in this example. 


Q: To what extent are you satisfied with The 
car you drive? MS 


(A response of '5” would mean that you are satisfied with the 
car you drive somewhere between "some extent” and "great 
extent" but closer to "some extent.'') 


3. Be sure each answer is clearly marked. 


PLEASE ANSWER EVERY QUESTION 
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Page 3 


PART I 
sU3Q101 
1. Age? 
a. under 20 f. 40 to 44 (25) 
b. 20 to 24 g. 45 to 49 
cT 25 to 29 h. 50 to 54 
d. 30 to 34 i. 55 and over 
e. 35 to 39 
SUBQ102 
2. Sex? 
a. Female (26) 
b. Male 
SUBQ103 
3. Years in the Coast Guard? 
a. Less than 1 ~ fo to 7 (27) 
b. One 4 70.10 
c. Two Dose 619 102 
d. Three i. More than 15 
e. Four 
SUBQ104 
4. Years in current assignment? 
a. Less than 1 1.9 10.7 (28) 
b. One ge. 6 to 10 
E. Two Do EL TO 13 
d. Three i. More than 15 
e. Four 
SUBQ105 
S. Time spent working for your current supervisor? 
Less than 3 months 5 to 7 years (29) 


3 to 6 months 
7 to 11 months 
1 to 2 years 

3 to 4 years 


8 to 10 years 
11 to 15 years 
More than 15 years 


i E 
H- D O 
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PART II 


Page 4 


This mart of the survey contains questions about what it's like to work for 


the Coast Guard. 


To what 


SUBQIG. a 


SUBQ106b. 


SUBQ106c. 


SUBQ106d. 


SUBQ106e. 


SUBQ106f. 


SUBQ106g. 


SUBQ106h. 


5UBQ106i. 


SUBQ1065. 


SUBQ106k. 


SUBQ1061. 


zent: 


Do the supervisors and those senior to them 
at this unit have an interest in the well 


being and morale of the people who work here? 


Do the supervisors and those senior to them 
at this unit try to improve working 
conditions? 


Do your supervisors and those senior to them 
at this unit schedule the work that needs to 
be done with the subordinates in mind? 


Do you feel motivated to give your best 
effort to the Coast Guard? 


Do people who do the most on their jobs get 
rewarded the most? 


Are there things about working here that 
encourage you to work hard? 


Are decisions regarding the way work gets 
done made by those who have the best 
informtion? 


Is informtion in this unit widely 
shared so that those who make decisions 
have access to all available know-how? 


Is the amount of information you get about 
what is going on in your division adequate 
for you to do a better job? 


Do you get the information you need about 
your own job in order to do your job in the 
best way? 


Is your supervisor willing to listen to your 
ideas and suggestions? 


Are those above your supervisor open to your 
ideas and suggestions? 
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y Great extent 


(30) 


(41) 





SUBQ106 M- 


SUBQ106 2- 


Are probiems discussed in a professional and 
helpful manner? 


Do supervisors and those senior to them show 
concern and understanding for people when 
talking about problems? 


All in all, how satisfied are you with: 


SUBQIC 7. a 


SUBQ107b. 


SUBOTO7c. 
SUBQIO 7d. 
SUBQ107e. 
SUBQIO?7f. 


To what 


SUBQ10 8 a. 


SUBQ108b. 


SUBQ108e. 


The people in your division? 


With people in the Coast Guard who are 
outside your division? 


With your supervisor? 
With your job? 
With your pay? 


With the way problems get solved in your 
division? 


extent: 


Would you consider taking a job similar to 


the one you now have (outside the Coast Guard), 


in the same city, with no loss of benefits, 
and with a 10% raise in pay? 


Are you glad you chose the Coast Guard for 
a career over the other career opportunities 
you might have had? 


F- "Rot at ait 


ha 


Ver y 
dissatısfied 


| 


bo 


to 


d- Some extent 


Ha Neither satisfied. 


nor dissatisfied 


Page 5 


5 


O 


“I Great extent 


~) 


“ Very satisfied 


Io ot OS 6 7 


2 3 4 5 6 < 


Are yau committed to working for the Coast Guard 


as long as your personal situation (your 
health, spouse's or family's needs, etc.) 
allows you to? 
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(+2) 
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The last section 


PART III 


focuses on your observations. 


focused on your opinions and feelings. 


This 


section 


The following questions refer to how your supervisor deals with problems in 
your division. 


To what extent: 


SUBQ1O9. a. 


SUBOl 0%. 


SUBQ10%. 


SUBQ10%. 


SUBQ109%e. 


SUBQ109¢. 


SUBQ1098: 


SUBQ10%. 


SUBQ109;. 


SUBQ109;. 


SUBQ109kx. 


Does your supervisor keep up-to-date with 
theproblemsyouare experiencing on the job? 


Does your supervisor take time discussing 
your point of view on your work? 


Does your supervisor take time to ask you 
whether there are ways he or she can help 
make your job easier? 


Does your supervisor come to your work area 
to ask you whether you need any help to make 
your job easier? 


Does a problem have to get out of hand before 
your supervisor chooses to deal with it? 


Does your supervisor fail to deal with 
problems before they become severe? 


Does your supervisor give you excuses for not 
solving problems that show you he or she 
won't "go to tat" for you? 


Is your supervisor unwilling to argue or 
fight for you to solve problems you bring up? 


Does your supervisor refuse to take on the 
people in power in order to remove 
complaints in your department? 


Is your supervisor supportive in solving work 
related problems you want help with? 


Does your supervisor bring resources to bear 
to help you solve problems on the job? 
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SUBQ1091. 


SUBQ10%. 


SUBQ10%. 


SUBQ10%. 


SUBQ10%. 


Does your supervisor say he or she will take 
action on a problem but then never get tack 
to you to solve it? 


Does your supervisor promise to see ma” can 
be done about a problem but then never let 
you know what he or she did to solve it? 


Is your supervisor quick to follow through 
on problems you bring to his or her attention? 


Does your supervisor take action in a timely 
way to solve complaints you bring to his or 
her attention? 


Does your supervisor get on your case too much 
about little things that are not worth the 
time they'd take to fix? 


10. Talking About Problems on the Job 


SUBQ110a- 


SUBQL10b- 


When your supervisor brings up a problem, 
to what extent is he or she clear about 
exactly what is bothering him or her? 


To what extent is your supervisor clear 
about the facts of problems? 


(That is, to what extent does he or she use 
specific statements such as, ‘You filed the 
Jones file under the K's" instead of vague 
statements such as, ‘You aren't filing these 
correct ly.") 


11. Talking About Problems 


SUBQ111a- 


SUBQ111b- 


To what extent does your supervisor put you 
down when describing problems? 


To what extent does your supervisor draw 
conclusions about you as a person when 
discussing problems? 


(That is, to what extent does he or she say 
things about you like, ‘You're lazy, you've 
got a bad attitude, you're incampetent," 
instead of just describing what is wrong with 
the job?) 
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12. Listening to You 


When you talk with your supervisor about work, 
to what extent does he or she: 


SUBQ112 a. 


SUBQ112 b. 


SUBQ112 c. 


SUBQ112 d. 


13. aÈ 


SUBQ113 b. 


SUBQ113 c. 


SUBQ113 d. 


Listen to your point of view without 
interrupting or cutting you off? 


Demonstrate by restating that he or she 
fully understands the point you are trying 
to make? > 


Accurately summrize your feelings cn the 
matter? 


Carefully listen without arguing or becoming 
upset? 


To what extent does your supervisor impose a 
solution to a problem without first stopping 
to figure out what is going on? 


To what extent does your supervisor "shoot 
from the hip" when solving problems instead 
of stopping to learn about the problem first? 


To what extent does your supervisor blame you 
for problems that aren't your fault? 


When discussing a problem with you, to what 
extent does your supervisor assume you're 
the cause of the problem when you're not? 


14. Explaining the Reasons Why Something Must be Done 
a Certain Way 


SUBQ114a- 


SUBQ114b. 


When discussing a problem, to what extent 
does your supervisor clearly explain what 
would go wrong with the job if the problem 
weren't corrected? 


To what extent does your supervisor explain 
how correcting a problem affects the job? 
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15. Answering Questions About Why Samething Must be 
Done a Certain Way 


50801152- 


80801 1 26. 


06001 1 5 ~" 


When answering questions about why something 
must be done a certain way, to what extent 
does your supervisor order you to do it the 
way he or she wants? 

When answering questions about why something 
mist be done a certain way, to what extent 
does your supervisor threaten you with what 
might happen if you don't do what he or she 
wants? 


When answering questions about why something 
must be done a certain way, to what extent 
does your supervisor us his or her "stripes" 
aS your supervisor to get you to do what he 
or she wants? 


16. Respecting your Ideas 


SUBQ1 16a. 


SUBQ116b. 


To what extent does your supervisor treat you 


in a way that shows he or she values your 
experience and opinions on the job? 


To what extent does your supervisor show 


respect for your ideas and abilities on the 
job? 


17. To what extent: 


SUBQ117a. 


SUBQ117b. 


Does your supervisor try to find ways to 
make the job easier in the future? 


Is your supervisor concerned about making 
the job less difficult the next time you 


have to do it? 
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18. After you and your supervisor have discussed a 
problem, to what extent: 


subOlléa. 


SUBQ118: 


ewieo118°° 


SUBQ118%° 


Does your supervisor leave you guessing about 
what should happen next? 


Is it left unclear as to who will do what to 
solve the problem? 


Can you be sure that your supervisor will 
really followup to see that the problem is 
solved? 


Are you able to trust that your supervisor 
will do wnat the two of you have agreed 
needs to be done? 


19. Dealing with an Upset Subordinate 


SUBQ119*° 


SUBQ119b. 


SUB0119c. 


20B0119d. 


When dealing with an upset subordinate, 
to what extent does your supervisor get 
angry him or herself? 


When dealing with an upset subordinate, 
to what extent does your supervisor 
get into an argument? 


When dealing with an upset subordinate, 
to what extent does your supervisor ask 
what has made the person upset or angry? 


When dealing with an upset subordinate, 
to what extent does your supervisor 
ask the person what is bothering him 
or her? 


SY 


| Not at all 


Some extent 


ne 
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5 6 7 
5 6 7 
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20. Doing Well cn the Job 


SUBQ120a. 


SUBQ120b. 


When you have done well on the job, to mat 
extent does your supervisor simply ignore 
what you have done? 


When you have done a good job, to what extent 
does your supervisor express his or her 
appreciation for what you have done? 


21. To what extent: 


SUBQl2]la. 


SUBQ121b. 


Does your supervisor act in ways that make 
it hard to trust him or her? 


Does your surervisor tell you whatever he or 


she thinks you want “o hear in order to get 
you to do what he or she wants? 
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Not at all 
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BI SUPERVISORY ORGANIZATION SURVEY 

This questionnaire was given to supervisors who were 
trained or scheduled to be trained as part of the Problem 
Belving Skills for Managers Training Program. The first 
five questions asked for some biographical data of the 
Survey respondents. SUPQ1IO6A through SUPQ1O3C asked for 
the supervisors' attitudes or opinions about what it is 
Bere tO work in the Coast Guard (i.e. Organizational 
Climate, Satisfaction and Commitment). The remaining 
questions dealt with the supervisors knowledge of problem 


solving and their perceptions of organizational support. 
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SUPERVISCRY ORGANIZATION SURVEY 


IMPORTANT PLEASE READ 


This questionnaire is being given to you as part of a study to measure your 
opinions and observations about your work. All your answers will be 
strictly confidential. Only the researchers at Interact Performance Systems 
will have access to your questionnaire. 


This questionnaire will be repeated in a few months, and we would like to 


learn your views at both times. In order to do this, please print your name 
in the space below. 


Name: Ea 


Once again, only the researchers at Interact Performance Systems will have 
access to your survey. 





Reprinted With Permission 
Copyright, Interact Performance Systems, Inc., 1982 
All Rights Reserved 
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Page 2 
INSTRUCTIONS 
l. Most questions can be answered by choosing one of the answers given. If 


you do not find the exact answer that fits your case, choose the one 
that is closest to it. 


2. Answer questions by circling the number of your answer choice, as shown 
in this example. 


Q: To wat extent are you satisfied with the 
car you drive? Wee 3 4 (6) 6 7 


(A response of "5" would mean that you are satisfied with the 
car you drive somewhere between "some extent" and "great 
extent" but closer to "some extent.") Ä 


3. Be sure each answer is clearly marked. 


PLEASE ANSWER EVERY QUESTION 


gT 





under 


20 
25 
30 
35 


er 


a. 
b. 


Female 


to 


in 
eo te 


to 
to 


Male 


SUPQ103 


3. 


Years in the Coast Guard 


a. 
b. 
C. 
d. 
e. 


Less than 1 


One 
Two 


Three 
Four 


SUPQ104 


4. 


SUPQ105 


Sr 


Years in current assignment? 


a. 
b. 
C. 
d. 
e. 


Less than 1 


One 
Two 


Three 
Four 


20 
24 


34 
39 


PART I 


40 to 44 
to 49 
50 to 54 
55 and over 


H- [T Q hh 
Ha 
un 


ato 

8 to 10 

Jer tos Lo 
More than 15 


Pp OF OQ ro 


DIEGO E 
8710.10 

1r tO 15 
More than 15 


P- DO bh 


Time spent working for your current supervisor? 


a. 
b. 
c: 
d. 


e. 


Less than 3 months 
3 to 6 months 

7 to 11 months 

l to 2 years 

3 to 4 years 


5 to 7 years 

8 to 10 years 

li tō years 
More than 15 years 


H- qq or 
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PART II 


Page 4 


This part of the survey contains questicns about what it's like to work for 


the Coast Guard. Once agin, 


To what extent: 


SUPQIO & a. 


SUPQ106p, 


SUPQ106c. 


SUPQ1 06d. 
SUPQ106e. 
UFQ OGF. 


SUPQ106g. 
SUPQ106h. 
SUPQ1061. 
SUPQ106;. 


SUPQ1O&. 


SUPQ1061. 


Do the supervisors and those senior to them 2 
at this unit have an interest in the well 
being and morale of the people who work here? 1 


Do the supervisors and those senior to them 
at this unit try to improve working conditions? 1 


Do the supervisors and those senior to them at 
this unit schedule the work that needs to be 


done with the subordinates in mind? 1 
Do you feel mtivated to give your best 

efforts to the Coast Guard? T 
Do people who do the mst on their jobs get i 
rewarded the most? T 


Are there things about working here that , 
encourage you to work hard? 1 


Are decisions regarding the way work gets 
done made by those who have the best 
information? 1 


Is informaation in this unit widely 
shared so that those wno make decisions 
have access to all available know-how? 1 


Is the amount of information you get about 
what is going on in your division adequate 
for you to do a better job? 1 


Do you get the information you need about 
your own job in order to do your job in 
the best way? Ji 


Is your supervisor willing to listen to your 
ideas and suggestions? 1 


Are those above your supervisor open to your 
ideas and suggestions? 1 


23 


your responses will ke confidential. 


2 


ty 


to 


D 


Some extent 


NS 


5 


6 


y Great extent 


(30) 


(41) 





EUPQ105 m. 


SUPQ106 n. 


Are problems discussed in a professional and 
helpful manner? 


Do your supervisors and those senior to then 
show concern and understanding for people 
when talking about problems? 


All in all, how satisfied are you with: 


SUPQ107. a. 
SUPQ10/ b. 


SUrPQ10/7 c. 
SUPQ10/ d. 
SUPQ107 e. 
SUPQ10/7 f. 


The people in your division? 


With people in the Coast Guard who are out- 
Side your division? 


With your supervisor? 
With your job? . 
With your pay? 


With the way problems get solved in your 
division? 


To what extent: 


SUPQ108. a 


SUPQ108b. 


SUPQ108c. 


Would you consider taking a job similar to 


the one you now have (outside the Coast Guard), 


in the same city, with no loss of benefits, 
and with a 10% raise in pay? 


Are you glad you chose the Coast Guard for 


a career over the other carreer opportunities 


you might have had? 


Are you committed to working for the Coast 
Guard as long as your personal situation 
(your health, spouse's or family's needs, 
etc.) allows you to? 


94 


Not at all 


m 


Very dissatisfied H 


pa 


to 


to 


Some extent 


H> 


Neither satisfied 
nor dissatisfied 


4 


4 


+ 


Page 


6 


6 


6 


Great extent UI 


I 


=] 


S Very satisfied 


7 


(42) 


(52) 





Page 6 


This part of the survey contains questions about different approaches you 
might use to solve problems on the job. Different training programs 
recommend different approaches to solving problems, but we are interested in 
your opinion as to which approaches you find useful in the Coast Guard. 


1. When beginning a problem solving discussion with E = < 
a subordinate, to what extent do you feel it is = = x 
useful to: = a = 
2 € © 
SUPQ109a. Begin the discussion by noting what the sub- 2 A S 
E ordinate is doing well before bringing up 
the problem? 52 Soe 5 06 7 (53) 
SUPQ109b. Begin by discussing the facts and details of 
the problem so that you won't get into an 
argument about what happened? L va. 2d S 6 
SUPQ109c. Begin the discussion by asking what is going 
on so that the subordinate will feel free to 
discuss his or her concerns? 12 122333 E 600 
2. To help a subordinate overcome a problem that is 
preventing him or her from doing his or her job, 
to what extent do you feel it is useful to start 
by: 
SUPQ11A- Finding someone with more experience or know- 
ledge than the subordinate to help him or her 
with the job? IS 4 5 O 7 
SUPQ110b. Asking the subordinate what he or she thinks 
is the best way to solve the problem? 00021 4 5 G 7 
SUPQLIC: Using your own skill to decide what needs to 
be done and have the subordinate do it? ds 4 25> 6 -7 (58) 
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3. When 


subordinates complain about doirg a job 


that is hard but necessay to do, to ynat ex- 


cent 


SUPQlila. 
SUPQ111 > 


SUEQ111 c. 


SUPQ111 d. 
SUPQ111 e. 


SupQ111 f. 


do you feel it is important to: 


Maintain control by focusing on the specific 
disciplinary actions you could take? 


Remind them they work under you and that it's 
your job to make the decisions? 


Stay on top of the situation by telling 
them that they must do the job the way you 
tell them to? 


Let them know you will help them later if 
they help you now? 


Promise them some sort of reward for putting 
out the extra effort? 


Remind them of what could happen to the job 
if they do not put out the extra effort? 


4. When one of your subordinates gets upset or 
angry, to what extent do you feel it is useful 


TO: 


SUPQ112 2- 


SUPQ112 b- 


SUPQ112 c- 


SUPQ112 d. 


SUPQ112 *- 


SUPQ112 f- 


Inform the subordinate of the disciplinary 
actions you will take if he or she doesn't 
control his or her temper? 


Ask the subordinate to cool off before 
discussing the matter with you? 


Ask the subordinate to go for a walk, get a 
drink, or take a break so that he or she 
will be less emotional when you discuss the 
problem? 


Avoid getting into the subordinate's emotions 
by focusing on the job? 


Ask for details about what is making the 
subordinate upset? 


Tell the subordinate you have felt the same 


way before and that you sympathize with his 
or her anger? 
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Not at all 


> 


Sume extent 
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A Great extent 


(59) 


(70) 





5. When you have to deal with a tough problem or a 
touchy situation with one oz your subordinates, 
to what extent do you: 


SUPQ113a. 
SUPQ113b. 
SUPQ113c. 


6. To 


SUPQl14a. 
SUPQ114b. 


SUPQ114¢. 
SUPQ1144- 


SUPQ114®- 
supqll4f- 


SUPQ1148- 
SUPQ114h. 


SUPQ114i. 


SUPQ1143- 


SUPQ114X- 


SUPQ1141. 


Feel stress or tension? 


Feel confident and sure? 


Feel annoyed or irritated? 


what extent do your subordinates: 


Create problems you have to solve? 


Need to be watched if they are to put out 
their best effort? 


Need to be told what to do next cn the job? 


Lack the ability or experience to do their 
jobs without your guidance? 


Try to appear "innocent" instead of taking 
responsibility for problems they have caused? 


Give questionable or unlikely excuses to 
avoid blame? 


Try to undermine your respect and authority? 


Act in ways that question your leadership? 


Take offense at little things that shouldn't 
matter? 


Get angry or defensive without good reason? 


Get frustrated too easily when a difficult 
job must be done? 


Try to take advantage of you if you try to 
be their friend? 


OF 


= Not at all 


pa 


> 


to 


yp Some extent 


~ 


~ 


Page 


gl 
o 


Great extent 


N TA 


=.] 


(71) 


80 ) 
CARD 2 


(25) 


(29) 





POLIP 


SUPQ11 5P- 


7. To what extent: 


Is just doing a good job important to your 
subordinate? 


Do your subordinates take an interest in 
doing their best on the job? 


8. To what extent do you: 


SUPQil6 a. 


SUPQ116 b. 


SUPQ116 ec. 


SUPQ116 d. 


SUPQ116 e. 


Set aside extra time each day to ask sub- 
ordinates about problems in their work areas? 


Sit down and plan how you will solve a prob- 


lem with a subordinate before going out and 
solving it? 


Rehearse in your mind what you will say to a 
subordinate before starting a problem-solving 
discussion? 


Pause to list in your head what the results 
of a problem might be before discussing the 
problem with a subordinate? 


Stop to think of all the reasons a job needs 


to be done a certain way before discussing 
the job with a subordinate? 
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Ha Not at al! 


Ha Some exten! 
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9. To what extent do other supervisors you work 
with: 


SUPQ117A- 
SUpqı17b- 
SUPQ117¢: 


SUPQ117¢: 


SUPQ117e. 


SUPQ117f. 
SUPQ11 7g. 


SUPQ1 1 Mm. 


Discuss problems with you before the problem 
gets out of hand? 


Ask for your point of view as to „hat is 
causing a problem? 


Work witk you instead of blaming you when 
problems come up. 





Discuss problems without becoming upset or 
raising their voices? 


Show respect for your experience and 
expertise? 


Follow through on their commitments to you? 


"Go to bat" for you by taking on others 
when it is required? 


Take action on problems that you bring to 
their attention? 


10. To what extent does your supervisor: 


SUPQ1182. 
SUPQ118b- 
SUPQ11&. 
SUPQ11 8. 
SUPQ11&- 


SUPQ11 £- 
SUPQ11 Ê: 


suPQ1131. 


Discuss problems with you before the problem 
gets out of hand? 


Ask for your point of view as to what is 
causing a problem? 


Work with you instead of blaming you when 
problems come up? 


Discuss problems without becoming upset or 
raising their voices? 


Show respect for your experience and 
expertise? 


Follow through on their commitments to you? 


"Go to bat'" for you by taking on the others 
when it is required? 


Take action on problems that you bring to 
their attention? 


J9 


| Not at all 


dy 


(0 


extent 


Ja Some 


ug 
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extent 


~) Great 
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D. MULTIPLE CHOICE QUESTIONNAIRE 

This questionnaire was given to supervisors who were 
trained or scheduled to be trained as part of the Problem 
vine Skills for Managers Training Program. MCQ101 
through MCQ115 measured the supervisors' knowledge about 
problem solving. The remaining questions dealt with the 
supervisors! recognition of opportunities to use problem 


solving skills. 
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INTERACT PERFORMANCE SYSTEMS 


MULTIPLE CHOICE QUESTIONNATRE 


The following questions provide situations you might face 


at work, and give five different ways you might respond to 
them. Pick the one best response by circling the number 
inntrons: OL it. 





MCQ101 


A. You notice a person who has been working for you only a short period of 
time using the wrong form for an important report You approach him or 
her and state: 


l. 


2. 


5. 


“C9102 


'Do you need any help on this?" 


'You're using the wrong form for this report. Is there anything we 
can do to avoid this happening in the future?” 


"I notice you are using the ŒG 33124 form and this report calls for 
the 3307 form." 


"When you use the OG 33124 form we don't get the information 
required by by District." | 


"Is there anything I can do to help you learn which forms to use for 
the different reports you prepare?" 


a n talking with a subordinate, you become aware of a rather complicated 
problem. You have a fairly good idea why the problem exists, but are 
not totally certain. 


l. 


Ze 


"You seem to be having a problem with . . . Is it because Of . . .?" 
'dere is what I think is causing the problem... What do you 
GRE 


"Thanks for pointing the problem out. I'll check into it and get 
back with you later this afternoon." 


"Thanks for pointing the problem out. Do you want me to get you 
some help to solve it?" 


‘What do you think might be causing this problem?" 


Reprinted With Permission 
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M 


"05 


E~n- of your subordinates finishes a complicated inspection ahead of 


schedule raking it possible for you to get under way ahead of time. 
You approach the subordinate and state: 


1. "Finishing that inspection ahead of schedule really helped out. 
What can 1 do to help you beat schedules in the future?" 


2. ‘Finishing that inspection this morning made it so I could get under 
way ahead of time. Thanks." 


3. "I really appreciate your finishing that inspection ahead of 
schedule this morning. Thanks." 


4. ‘Because of your good attitude, we were able to get under way ahead 
of schedule. That was really important to the crew. Thanks." 


5. ‘You're a real dependable person. Being able to depend on you takes 
alot of pressure off me. Keep it up." 


MCQ104 


D. 


You observe a subordinate using a shortcut to complete an important 
electrical test. After you explain that failure to follow the test 
procedures could produce inaccurate results, the employee says: 


"This shortcut won't make the test all that inaccurate, 
and besides, we've got such a tacklog of these tests. 
This shortcut really helps me out." 


Knowing that the regular procedures are, in fact, appropriate and that 
you have to motivate the person “o use them — you respond: 


1. ‘You seem upset, is it because you feel the tests take too much 
time?" 


2. 'Maybe these procedures are a bit too rigid. I'll check into it and 
let you know." : 


3. "If the tests are any less accurate it could damage the equipment." 
4. "Is there anything I can do to help you follow the correct 
procedures?" 


5. "I know the procedures seem picky, but I'd really appreciate e Lt 
you would follow them exactly." 
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E. You observe that the lookout on watch is absent-mindedly staring at the 
deck rather than alertly scanning the horizon. After explaining that 
the way he or she is looking for ships is not active or alert enough, 
the lookout Says: 

"Trying to keep a lookout here is just busy work. There 
are hardly ever any ships out here. Besides, the radar 
will show what's out there anyway." 

Knowing that keeping an active watch is important, you respond: 


1. "I appreciate that it's tough, but it's your job and I have 
confidence you can do it." 


2. "I can see yore really bored. Is there anything I can do to help 
you stay alert? 


3. "I understand your concern, but trust me, keeping an alert watch is 
erictical." 


4. "I know what you mean. Maybe we can manage with just the radar for 
a while." 


Sa it you don = Keep an alert wa-cch we could miss craft that radar 
doesn't pick up.” 


MCQ106 


F. A subordinate has just come to you with a work-related problem. The 
Subordinate is VERY ANGRY about the equipment he or she has to work with 
and states: 


"This #*%! equipment is driving me nuts! 
It'S way too slow!” 


You respond 

1. ‘What seems to be the exact problem?" 

2. ‘What's making you mad is that the equipment ee you down?" 
3. "Could you help m understand how this could affect our schedule?" 
4. "Is there anything I can do to help you solve the problem?” 


5. ‘Do you think we can gather information in order to figure out why 
it is slowing so much?" 
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MC0107 


G. You notice an experienced subordinate involved in an unsafe work 
practice. You approach him or her and state: 


1. ‘This is the third time this week I've noticed you standing inside 
the recommended safe distance of this equipment." 


Cae Olesnoulan tebe tdernesthac. You could get hurt.” 
3. "If that machine acts up it could break your wrist." (31) 
4. "I'd really hate to see you get hurt. Try to be safer fran now on." 


5. 'You're working in an unsafe manner Is there anvthing we can do so 
it won't happen in the future?" 


MCQ108 


H. You've just spoken to a subordinate about using an incorrect procedure. 
The suborinate becomes furious and states: 


"I'm not the only one who does the job this way! 
Why pick on me?" 


You respond: 


1. "Is there a way I can help you so you won't have to use this 
incorrect procedure in the future? 


2. ‘Using this procedure could result in a loss of water tight 
integrity." 


3. "I know other people do the job this way too, but right now we're 
talking about you." (32) 


4. 'You seem upset. Do you think I'm picking on you?" 


5. "I can see you're pretty upset about this. Why don't you take a 
break for a few minutes and then we can talk about it." 
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One of the best subordinates in your engineering department has been 
working for several hours on a very complicated O e alo 
conditioning system and has made little headway. You approach the 
subordinate and he or she says: 


You 


"Let's see if I can explain what's going on here. The 
inner-flange on this part needs to be rounded to within 
one one-thousandth in order to set the bearing and seal 
eenbiparlonsnlıvercorsrart Of it ground out, but the 
ledge where the seal goes isn't right and I need to figure 
out a way to make a diagonal cut so that I can get it to 
tolerance." 


respond: 


"Sounds to me like you've got a good start at solving the problem. 


If you keep at it, I have confidence that you'll be able to solve 
Leo! 


"I'll get another engineer to help you. Meanwhile, you keep working 
at it so that we can complete this repair on schedule and meet our 
commitment by five tonight." 


"This problem sounds pretty complicated, what do you think is 
causing it?” 


"It sounds to me like you could use some help from the company that 
designed this." 


"Let's see if I understand.: You've got part of the job done, but 


you are being slowed down because of troubles in grinding out the 
ledge. tr 


Answer the following questions by circling the number in front of 


the 


response that you think best deals with the situation. 





In observing a problem with a subordinate, it is best to first: 


Ask the subordinate what he or she is doing and why. 
Ask wnat you can do to help. 


Make the subordinate feel at ease by first striking up a friendly 
conversation. 


Describe the nature of the problem in detail. 


Explain the consequences of what the subordinate is doing. 
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K. When working witha subordinate in order to find out why a particular 
problem he or she faces exists, it is best 10: 


l. Bring two or more subordinates together to involve them 211 in 
participative decision making. 


2. Outline what you think the source of the Den is and ask the 
subordinate what he or she thinks. 


3. Ask the subordinate if he or she would like you to bring in an 
expert to help solve the problem. 


4. Ask the subordinate what he or she thinks the source of the problem 
is. 
5. Ask what you can do to help. 
MCQi12 


L. When a subordinate questions the reason why something has to be done a 
certain way (and you know the reason), it is best to: 


1. Explain the impact that doing it the required way has on the way the 
job comes out. 


2. Express your appreciation for the subordinates concern, but maintain 
your authority by assuring him or her that those who designed the 
method knew what they were doing. 


3. Work with the subordinate in order to determine what can be done in 
order to simplify making it the required way. 


4. Ask the subordinate whether you can help him or her do the job in 
the correct way. 


S. Express your appreciation for the subordinate’s concern and tell him 
or her that you will check into the matter in detail. 


MCQ113 
M. When a subordinate does an outstanding job, it is best to first: 


1. Indicate that you are pleased with what he or she had done and that 
you hope he or she will be able to achieve similar results in the 
future. 


2. Describe in detail what the subordinate did, express your 
appreciation and describe what happend as a result of it. 


3. Put the subordinate at ease by starting with some friendly 
conversation. 


4. Express your sincere appreciation for what the subordinate did, and 
explain what happened as a result. 


S. Express your appreciation, describing what happened as a result, and 
tell them you're glad they have such a good attitude. 
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N. in dealing with an angry subordinate. it is best to: 


ie 


2: 


MCO115 


Go right to problem-solving in order to avoid having the subordinate 
get more and more angry. 


ask the subordinate to explain what it is that is making him or her 
angry. 


Mention something the subordinate has done well to show that you 
value him or her. 


Wait for the subordinate to calm down and then come tack and solve 
the problem later 


Maintain your control by using a firm tone of voice and explaining 
the problems that happen when a person loses his or her temper on 
the job. 


O. When there are several possible ways to solve a problem that a 
subordinate faces, and you think that some of them would probably work 
better than others, it is best to first: 


le: 


2: 


Ask the subordinate for the solution that he or she thinks would 
work best. 


Write down the solutions that you think would work best, and discuss 
them with someone who has had experience with similar problems. 


Express your appreciation for the ideas and ask the subordinate to 
check them out with someone with more experience. 


Act on the solution that you think is best and have the subordinate 
gather information about the problem to make sure that the solution 
works. 


Call over another subordinate in order to gain more participation in 
solving the problem. 
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At one time or another, supervisors ask their subordinates 


different reasons why a supervisor might ask subordinates 


LOU 


their ideas. Please read each of the four reasons and 


then place a "1" by the reason that best represents why 
you ask subordinates for their ideas. Then place a '2" by 
the second best reason, and ''3" by the third best, and a 





It is best 


MCQ116A__ 4: 





MCQ116B8 —— B 
olc — ° 
MCQ116D D. 
It is best 
| aae ^ 
= 

- c 
MD D. 

It is best 

. —— *: 
Mes ° 

. > 
. ?: 


"4" by the fourth best reason. 


for *heir ideas. In the following questions we give four | 
| 





to ask subordinates for their ideas because: 


You can help subordinates learn important skills that they need 
by having them work through problems themselves. 


Subordinates can help a supervisor out of a tough situation. 


Subordinates are more likely to try the solution if they have 
had a real part in the decision. 


Since subordinates are closest to the problem, they might 
provide informtion you were unaware of. 


to ask subordinates for their ideas because: 


Supervisors can't be expected to know everything about each job, 
so they need to rely on subordinates' ideas. 


Since subordinates are closest to the problem, they probably 
have the best informtion. 


Going to all the trouble to involve subordinates can be worth it 
because subordinates may work harder in the long run. 


Subordinates should be involved simply because they need to 
learn and grow. 


to ask subordinates for their ideas because: 


You can get subordinates to think of your solution as their 
"own" idea. 


Even though the ideas may be impractical or naive, it is 
important for subordinates to feel involved. 


You're more lixely to identify the real problem if you use the 
subordinates' expertise. 


Supervisors are so involved in managing that they must rely on 
the subordinates to work through the problems. 


TOS 


(40) 


(43) 
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E. SUPERVISOR EVALUATION OF TRAINING 

This questionnaire was given to supervisors who had 
meen trained aS part ot the Problem Solving Skills for 
Managers Training Program. It was designed to measure 
the supervisors' reaction to the training program and 
er motivation as determined by intrinsic and extrinsic 


mactors. 
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ESSE PoR ORMANCE SISTEMS 


SUPERVISORY EVALUATION OF TRAINING QUESTIONNAIRE 


Thessuürsese ofthis guessionraize is to measure veour 
Bermleon Of Ene Mater er ecrainlina program you have now 
SGompleted. | YOourwandswers Wil!) Be Kept confidential, so 
please feel free to say wnat you feel. 





Oneemaga a, only exe cesecarchers at int 
Systems will have access to your survey. 


Reprinted With Permission 
Cooyrignt, Interact Performance Systems, Inc., 1982 
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Great extent 
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INSTRUCTIONS 
Most questicns can be answerec by choosing one of the ans 
AI e ns ne exacs answer that fits you 
GaSe, cuOOse wen] Ome that 2S Closest to it. 
Answer questions by circling the number of your answer choice, 
as shown in this example. 
a ` 
oat = 
= y 
o = 
x 
= © 
a 
y 
= = 
© E 
= Y 
O: To wnat extent are you satisfied 
with the car you drıve? 1 2 3 468 6 
(A response of "5" would mean that you are satisfied 
with the car you drive somewhere between "some extent” 
ence sd2ee: extent but closer to "some extent.”). 
Be sure each answer 1s clearly marked. 
PLEASS ANSWER EVERY QUESTION 
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SETQIOIR. 


SETQ101B. 
Semol01C. 


SETQ1010D. 


SETQ101E- 


SETQ101** 


SETQLOIG. 


SETQ101H. 


T LA 


SETQ1024- 
Se 201025. 


SETOLI2S, 


SETQ102D. 


wnat extent are the skilis € 
in tne program effective when 


Weel CO tne Seals work? 


(3 


x 
O fv 
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them to: 


Beci naisc Uss nga problem w1t5n 


a subaereinace no is pezfocrmins 
poorly om the Job? 


Figur] out way asubordälnate 15 
not performing well on the jop? 


Encourage a poorly performing sub- 
o -dinate eoewancscO wOrk harder? 


Involve a subordinate in finding 
a solution to a tousn problem 
ons the Jos? 


Get an angry subordinate to caim 
down? 


Help a suborniete see that vou 
üUndezstandasn:s os her deseript 
of a complex problem? 


Figure out long-rerm soluti 
tnec will keep broblems 270 
coming Up ein she sucure ? 


Make sure your subordinate under- 
stands exactly what you expect 
aom Or her to do =o solve a 
problem? 


summary, tO what extent: 


Do you think the skills taught 
actually work? 


Do you disagree with a lot of 
wnat was taught in the program? 


Are the skills taugnt in the 
Program toG soft sO that if you 
use them your subordinates will 
take advantage of you? 


Are the skills taught in tne 
program too undernanded so 

that if you use them you feel 
you are taking advantage of your 
Subordinates? 
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Not at all 
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Some extent 
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TIET. How worthwhile was the era ining? 


Rouvnar extrent co vousehink the 
zrainınc: 


SETQ103 a. 
SETQ103 3. 


SETQ103C. 
SETQ103 D. 


SETQ103 =- 


SErQl103F. 


SETQ103G. 


T RNa kındcecorzsmpace ale the training 


Was worzn chen meranec extort 
Spent One. 


Was an unol 


easa: 
fortable exper 
g 


H 
oD 
0 
0 0 
J 


Was something you enjoyed? 


Was largely a waste of time 
because you had sımilar 
raining 1n the past? 


Was a waste of time because 
it was not related enough 
to the real supervisory 
problems you face? 


Made you more comfertable with 
the way you have to treat your 
subordinates in order to get 
things cone? 


Wasted valuable time that you 
would rather nave spent 
elsewhere? 


have? ' 


To what extent do you think the 


1 pelo a Lo de 

SETQ1044- Improved vour skills in dealing 
with tough situations with your 
subordinates? 

SETQ1OSB. Was something you were able to 
use on a daily basis? 

SETQIOSC. Was something you didn't really 
neec because you were satisfied 
with your skills when the training 
started? 

SETQ104D. Helped you do a better job? 

SETQ104E. Benefited your subordinates? 

SETQLO4F. Increased the amount of work your 


supordinates do? 
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V. How did the other veopie wno were tx 
in the same workshop group as you fe 


aıned 
2] 


about thernrsgram? 


Monnia ct ex ono. 


ETQ105A. 


ETQ105B. 
0001 050. 


ETQ105D. 
IETOLOSE, 


¡ETQ105* : 
METOLOSG. 


¡ETQLOSH. 


00001 051. 
7701055 - 


Were Others in your tra.ning 
83696. 66 Cooperative: 


were tney "involveszzrn che training? 


Didi Ney SUPEOLe youn sez sorts to 
learn and oraertieerthesskılls.in 
class? 

Did others take the training 
seriously? 


Were others willing to try out the 
new behavıors? 


Did others seem to take the tralnıng 
as Just a came? 


Did others seem to act as 1í they 
were only. s3661ng Ghrougn the train= 
ing because they were rorced? 


vas chere an Individual or group 
who resisted tne program and lowered 
tne overall entnuslasm? 


Did others benefit from the program? 


Did others actually change the ways 
they work with pecple? 


Vi. How did other people in the organization 
feel about the program? 


SETQ1O6a. 
SETQIO6B. 


SETQIO6C. 


3ETQ106D. 
3ETQ106E. 


SETQ1O6F. 


Did the people above you in the chain 
of command support the program? 


Did other Key Supervisors support 
the program? 


Were your subordinates aware of 
ehe Eraining program before it 
began? 


Were your subordinates generally 
supportive of the training program? 


Did vour subordinates make fun of 
your attempts to use the skills? 


Did your subordinates surcport your 
efforts to use the skills with them? 
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00: Wnat 
the 


TO w 
skit 


SETQ107A- 


SETQ107B. 
SETQ107c. 


SETO107> 
SETQIO7E. 


veel. ¿What 
Graz 


SETQ1084- 


SETQ108B. 


SETQ108C- 


P) 
fu 
GQ 
D 
N 


vete ene reasons fOr trying us = 
SUL SS — c © 
= W ~~ 
내 a z x 
Nas extent (alszyou try ene ce zn y 
SE v -_ 띠 
Y a 
> = V 
Because the trainers were senicr = = m 
ES VOUranGgnecmecealse vou thought 
that the skills might work? ee 7 en) 
Because the skills made sense? AS: ud AS G:F 
Because the skills seemed to work? 1 2 3 4 5 6 7 
Because you felt comiortanle 
Using the Skills? ee sn ° / 
Because your supervisor supported 
using the skills? LS AS 7 (62) 
nassen) kerasıng cenroush tie 
ming? 
Overall, how would you rate the number 
Ser eszalnıng sesslens? 
is LOC. ev, 
Zen DOU] SNeg=2 eh. nunpaer. 
3. Seco many. 
Overall, how would you rate the pace of the 
training? 
PTOS S low: 
Zoe mouse, Blanc. 
3. Too fast. 
Overall, how would you rate the complexity 
Or ene ter ralining? 
l. Too simple. 
Zp cose zZ Che, 
3. Too complex. | (65) 





IX, ROW 


SETQ109 A- 


much practice was done? 
Weile vyeuswere Partiecipatiínce in <raining, on the averace: 
Row moc are meiras spen- Lraczııicing ce 
Renearsa! Cards in eacn session? 
10 vesssthan. 5 mınuzes So 3l to 40 minutes 
2 S to 10 minutes 6. 4] €o 50 minutes 
E lL. o 20 munutes Ho 5] to 60 minutes 
4. 21 £6 30 minutes 3. 61 to 70 minutes 
9. More than 70 mınutss (66) 


SETQ1098. 


SE oe LOE. 


SETQ109D. 


How many Rehearsal Card situations did you practice 
when using the cards in each session? 





hee Oto La E Lon Sa g to Y Situations 
Lo 2. <O. 3 Sa ea. Ons SO seo ll Siteuations 
3 4606 S Situations 1 = 1S Sas te SONS 
Zoo tO 7 esteuations Sk 4. torls Si tuations 
SeeMore than 1S situations (67 


How many times a week did you practice using the skills 
Decl lc ine sds cOecontracce tO practice? 


a NOne 0 DOUE 
2. One 6. Five 
3. Two 7. Siz 
4. Three 8. Seven 
MEREN or more (68) 


How many times during a week did you set aside a time 
or place to look for cnances to use the skills (Spontaneous 
eeneracts)?> 


l. None IS E 
2. One 6. Five 
3. Two 7. Six 
4. Three 8. Seven 
oe FEishut ox more Coa 


PIS 





SETQIOQ9E. How many times between each session cic your traine 
torvo aout usis the skills? 
l. None UE 
25. -ORe 6. “Fave 
3: Two iss “Sex 
4. Tnree 8. Seven 

So PELEAS O: MOEre 
X. How many times did you talk about the Interact training 


outside of class each week? 


ene 50x O. Ene right) 


SETQ110A. 
SETQ110B- 


SETQ110°- 
SETQ110p, 


CEEOL LO =. 
SETQIIOF. 


O ee aa 


SETQÍ11A. 


SETQ111 3- 


SETQ111€- 


SETQ111 D. 


Wai Gorher people going through traininng? 
NS OSA E SUELO TO (OSCE INSTIVETOES? 
Wen your SUPErVISOr? 

With your peers? 

Wich vour subsorainaces? 


wien vour ramilv? 


Not at all 


To what extent do you value the 
Ss canas ola ene program? 


pa 
bh 
uy 


To what extent are you committed 
to using the techniques in the 
program? 20227 3 


To what extent did you become ; 
excited about using 
tnerskıllszin sche program? Das a 


To what extent has this 

program interested you in 

more training of this 

type? BE 3 


= Some extent [|] [] | | OO a 


(Please write the number of 


Srocram 
tımes ın 


xtent 


e 


Great 


~j 


~J 


(71) 


(20) 





Pace Y 


In interviews people nave teld us that they often don't use the 

IS zom trainıne7srogzams as Often as they'd like. When 

asked way, they exalain hate, while they micht want to use the 

er. Ss a: zımes zney Merger." Thev are Sc used to their old 

Zaun aS ne cilnGS;ecadey soem ee sean to ERInk abour using the 

Dee In “fis section we ad like ts ask you some questions 

about this oroblem. 

2358 sos cs eno eres) You Rave used skills from this 
program, and where you were when you thought to use the 
skilis. We would like to know where people are and what 
they are doing when they "stop and think" of a chance to > 
use these skills. in 2 

= D T 
m © 
How frequently have the following state- m = 
ments been true for vou: v 5 ： 
_ > a 
SETQUINZ a. During a training session I though: S E e 
er an sppereunilty to use one of 
thesis. ees E SIA 
Sono. Ll Nad Sec asice a time to look 
Bomecnamceseromuse. one skills, and 
GUS nc that cime 1 saw (or thought 
of) a chance. ee Pe Weve ot Oe 7 
Beli tew lt was not seecitically looking for 
asenance to use tne sxiils, but i 
saw a problem ın my work area and 
TIOlGht, m This as a chance to Correct 
that problem I've never gotten 
around co solving.” Me. A ADO ee 
SETQ112 ¢- I Gidn'= see tne chance to use 
ehice= skit istat first DUS Found 
myself getting angry at someone 
and tnat reminded me to use the 
Skills, eo oe 4. 26002 
SETQLI2 =- I got halfway into a discussion 
and saw that what I had begun 
with wasn't working and that 
reminded me to use the skills. Lag ee u 2, 
SOM ) 1 theeent to use the skills be- 


cause the last time the discussion 
nhac blown up in my face and I hae 
said to myself, "Next time I'll 
use the skills." 


pa 
bo 
Us 
~ 
in 
Nn 
y 


118 





g 
fu 
Q 
(D 
t =) 
O 


XIII. Whenever you try something new, you have to concentrate 

Cie Shale eu und vor Nave =o pay close attention. 
SETQI13A With time, new activities cecome more familiar anc vou 

think about them less and less. For example, remember 
Vice wesarken nen zyoWw Tirst learned zo drive a car? 
SER ano zorsrnoreherar first, SUt with practice 
became routine. Tne same iS true with new supervisory 
S fla ls. Tae Sollowing 1ist descrilbes are stages in 
Gals Cnange process. Please check the box (one only) tnat 
best describes your useof the new o skıl]s, 


a. I almost never use the new skills witnout 
"being aware Of 1%" because they are stil! 
ünzramaııtar and take conscious ef ort. 


a 


Be. OCSasSional ti ese the new skilis without 
“being aware of it" because thev are 
becoming more Zamiliar and take less 
EONSEOULS SS 203. 


| 


c. I frequently use the new skills without 
"being aware of it" because tnev are 
becoming more familiar and take less 
Consellos éf or: 


| 


f 


+ 


d. I nearly alwavs use the skills without 
“being aware of it" because thev are 
quee ram ta sanG cake “lictle conscious =, 
De es Y 
ertor 3 
= = 
= de 
o 
` a 
© y 
XIV How frequently do vou use skillsmérom = . 
enezera.nıng Hros-am. = -- a le 
SETQ114a. At home with your family? ieee, Ss £ 5 6 
SETQll4b. At work with your subordinates? fee” 3 4005 6 
SEROLIZE. At work with other supervisors? 때 23 04795 6 
SETQ114d. At work with your immediate fae! 3 “42 25> O 
supervisor? 
SETQ114e- In volunteer settings (at 


H- 
ho 
us 
A 
n 
Dd 


Ghucei Clubs, etc.) 


1 60 


S Very Frequently 


~J 


ht 
=} 


(28) 





Y ~ 
y = 
= = = 
= ur en 
© Ù 
= = 
: 5 ~ a Y 
NOW  Erequentiv CON vou use = © = 
different skills in the program? > = T 
O Y a 
=~ ^ > 
SETQ115a. Communıicating the sıtuazion? 28 고 Sun) 
ros. Usin Sse cme mn Gre Mem = 2 Pee O a7 
SETQITS G P 
SETQ115¢- Solving me Va n zroslens? Ma ar Be 7 
SETQ115°- solving ábbi Yy orcslems? ee aoa oe Gd 
SETQ115e. Solving emergent problems? E AS, 6) 7 37) 


XVI. 


SETQ116 


SETQ116 
SETQ116 


SETQ116 
SETQ116 


SES 


Please rank order the usefulness of tne different skills in 
Ene woroocuatiwsewdeena + oY the skill you fine most Useful, 
Pee eo ene seeememmose useful, 2a "3" by the tnire most ` 
Bserul, a (4 Soueenemtourtnemoest useful, and a "5" Dy the 

Seo Cen mos: useful 


a. commenlcating =Ae situation. (38) 
Be USING Posltive reinforcement. 
Se, 2C Vine motiva Eon problens. 
ea. SClvineg ability problems. 

e. Solving emergent problems. 
Please rank order the training sessions by how interesting 

eney were for you. Place a "1" bv the most interesting session, 


ne gsegena most ünsereszeing, a “3" by the third most 
interesting and a “4" by the fourth most interesting. 


SETQ1172. The session covering communicating 


tne situation and positive reinforcement. (43) 


SETQ11#- The session covering motivation problems. 


SETQI1X. The session covering ability problems. 


, 


SETQ11A- The session covering emergent problems. (46) 


UT LI. 


If vou were in charce of the training and interested in 
getting people tor see all tre opportunities to use the skills, 
What, WOUla Vou do? 











12,0 





A. EIGENVALUES, 
Variable Est. Communalitv 
SUBQIO9A 0.87390 
SUBQIO9E 0.837936 
SUBQLOIC 0.92476 
SUBQ109D 0.83104 
SUBQIO9E 0671529 
SUBQLOIF 0.83852 
SUBQ109G 0.84904 
SUBQ109H 0.72915 
SUBQ109I 0.65462 
SUBQ109J 091061 
SUBQ109K 0.88108 
SUBQ1O9L 0.79981 
SUBQ109M 0.87280 
SUBQIO9N 0.88295 
SUBQ1090 0.88980 
SUBQ109P 0273339 
SUBQLIOA 0.79549 
SUBQ110B 0.86575 
SUBQ111A 0.86496 
SUBQ111B 0.87902 
SUBQ112A 0.79141 
SUBQ112B 0.88225 
SUBQ112C 0.86447 
SUBO112D 0.89431 
SUBO113A 0.32433 
SUBQ113B 0.89439 
SuBQ113C 0.91828 
SUBQ113D 0.85808 
SUBQ114A 0.86647 
SUBQ114B 0.87806 
SUBQLI5A 068 7595 
SUBQ115B 0.84638 
SUBQLL5C 0.84551 
SUBQ116A 0.90407 
SUBQL16B 0.88800 
SUBQ117A 0290372 
SUBQ117B 0.88038 
SUBQ118A 0.34664 
SUBQ118B 0.82674 
SUBQ118C 029195 
SUBQ118D 0.91688 
SUBQ119A 0.84129 
SUBQ119B 0.87510 
90801 190 0797212 
SUBQ119D 0.89147 
SUBQ120A 0.83710 
SUBQ120B US 1535 
SUBQ121A 0.74166 
SUBQ121B 0.84071 
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Standard Dev. 
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CORRELATION MATRIX FOR VARIABLES 
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